Facebook just made a huge upgrade to Oculus VR headsets

Here's how the Oculus Quest 2 just became a player in augmented reality.
Sign up for the Freethink Weekly newsletter!
A collection of our favorite stories straight to your inbox

This article is an installment of The Future Explored, a weekly guide to world-changing technology. You can get stories like this one straight to your inbox every Thursday morning by subscribing here.

Last week, Facebook made an announcement with big implications for the future of augmented reality (AR). Oddly, the announcement had nothing to do with Project Aria, the AR headset that the company announced in fall 2020.

Instead, it pertained to its latest virtual reality headset, the Oculus Quest 2 — the most popular VR headset on the market.

The announcement: An upcoming update for Quest will allow developers to access its Passthrough feature, “a way to build and test apps and seamlessly blend the real and virtual worlds.”

The difference between AR and VR: In conventional VR, like Oculus Quest 2, users who don the headset are immersed in a full virtual world, blocking out the entire real-world environment.

AR, on the other hand, involves integrating virtual content into the user’s view of the physical world (kind of like how Pokemon Go uses your smartphone camera to display objects in real space).

Now, with one stroke, Facebook’s software update has upgraded all of its Quest 2 VR headsets to have AR capabilities, too.

But how? The Quest 2 actually has a bunch of outward-facing cameras on the headset to help orient users in their physical space (and help them avoid crashing into walls). The Passthrough feature uses those cameras to display an immersive view of the user’s surrounding environment inside the headset.

But, until now, app creators couldn’t build anything with Passthrough.

By allowing content creators to access this feature, Facebook VP of AR/VR Andrew Bosworth hopes the move will be “an important step in unlocking the next generation of immersive experiences.”

This blending of realities allows users to imbue their physical environment with properties of virtual environments—in other words: augmented reality.

Cold water: The view of the physical world through the Quest 2 is still fairly low-resolution, and currently only depicted in black-and-white. Unlike AR headsets, such as the Microsoft HoloLens 2, the Quest 2 is not specifically designed for AR, and therefore is much more limited in where and how it can be used.

https://twitter.com/boztank/status/1418637721862561796

But still: People have been dreaming of the possibilities for AR interfaces for decades. Many current-generation AR headsets are prohibitively expensive ($2,000+) and have failed to live up to the immense hype.

The Quest 2, which retails at $299 and doesn’t require a connection to a PC or gaming console, is now by far the most accessible device where AR capabilities are possible.

The Varjo XR-3 headset began shipping earlier this year, but the respective headsets are aimed at two completely different markets. As a high-end enterprise device, the minimum cost of the XR-3 is $6,990.

Work and Play: Imagine being able to instantly change the color of any surface in your room — or apply a filter for everything in your view. Or draw all over your space in 3D. These are just a few of the creative applications that Facebook has depicted in its Passthrough API announcement. 

It could also fit in with remote workers, allowing them to fill their space with virtual monitors while still being able to see their desk and keyboard. Virtual meetings could also be done immersively — letting you see avatars of your coworkers situated in your physical environment.

Until now, these possibilities have been purely hypothetical for most people. Now that developers can start building these experiences on a more accessible headset, far more of us will be able to get a taste of the blended physical-virtual metaverse — which is fast becoming reality.

Related
Why harmony with nature is a myth
Slowing growth and limiting development isn’t living in harmony with nature—it is surrendering in a battle.
The unsung heroes restoring America after disaster
In partnership with McNulty Foundation
When disaster strikes, the workers helping us rebuild are often exploited. Here’s a solution to protect and scale this urgently-needed labor force.
LLMs are a dead end to AGI, says François Chollet
AI researcher François Chollet thought we needed a better way to measure progress on the path to AGI — so he made one.
The next gen leaders transforming Haiti
In partnership with McNulty Foundation
More than crisis and chaos. Meet the new leaders who are reshaping Haiti, starting with an education system that honors their true identity.
Solid-state batteries are finally making their way out of the lab
In partnership with Higher Ground
Solid-state batteries could soon challenge lithium-ion as the dominant tech for powering smartphones, EVs, and more.
Up Next
bipedal robot
Subscribe to Freethink for more great stories