Apple unveils visionOS 2 with spatial photo, video support as Vision Pro goes global

Apple announced visionOS 2, the second iteration of the operating system that powers its first mixed-reality headset, the Vision Pro at the WWDC 2024. The new update enhances the headset experience and packs features such as spatial photos and spatial videos. Essentially, these photos and videos have 3D depth in them, so you can immerse yourself into browsing photos and watching videos. Apple has also improved gesture support and an expanded virtual display for Mac users.

Spatial photos, videos

You can convert any photo from the Photos app in Vision Pro into a spatial photo with visionOS 2. Photos gain more depth and realism after they are converted to spatial photos, thanks to “advanced machine learning.” Apple is also adding SharePlay to Photos on Vision Pro to allow sharing the app with another Vision Pro owner through spatial Personas, an apparition-style hologram of a person that appears next to the app in the same physical space.

Similarly, spatial videos have 3D-level depth in them making them more immersive. Although the Vision Pro and iPhone 15 Pro can capture spatial videos, Apple is expanding the spatial video-recording devices to include the Canon EOS R7. A new spatial lens for the EOS R7 will arrive later this year to help record spatial videos, even in low light. Apple will also add spatial video editing capabilities to Final Cut Pro on Mac, while the Vimeo app designed for Vision Pro will let you upload and share these videos. YouTube is still not onboard.

Ultrawide Mac display

One of the best uses of Vision Pro is as a Mac display extender. Apple is enhancing the experience to include a higher resolution and larger size to the Mac Virtual Display on Vision Pro with visionOS 2. The new virtual display will simulate an ultra-wide screen, equivalent to two 4K monitors side by side. visionOS 2 also adds mouse support for additional workflow options, while the Vision Pro will now show you the physical Magic Keyboard even when you “are fully immersed in an Environment or app.”

Better customisation and gestures

Apple is improving how you interact with the Vision Pro with visionOS 2. That includes the ability to rearrange apps on the home screen, much like how you do it on iPhone or iPad. You can now bring up and navigate the home screen with a simple tap while flipping the hand over will open the Control Center. visionOS 2 also has support for other gestures, such as a wrist roll to take a peek at the battery status or the time. Safari on Vision Pro will support up to five simultaneous video streams, making it easy to catch up with different sports at once.

Vision Pro goes global

Post last year’s launch, Vision Pro drew both appreciation and criticism. But, for what it is worth, the demand for Vision Pro picked steam. Apple will finally sell the Vision Pro outside of the US soon. It will be available in China, Hong Kong, Japan, Singapore, Australia, Canada, France, Germany, and the United Kingdom starting later this month.