“Spatial Video: Apple’s Vision Pro Headset’s Killer App”
Apple’s iOS 17.2 update, released as a public beta today, brings a new feature that will change how we interact with videos: spatial video. This update allows iPhone 15 Pro and iPhone 15 Pro Max users to capture spatial video, a feature that will become indispensable once the mixed reality headset, Vision Pro, releases next year. The ability to capture and view spatial video, which simulates 3D depth, is a game-changer.
Apple has played the long game with its product development. A subtle change in design and functionality in the iPhone 15 Pro and Pro Max makes it clear that Apple had the Vision Pro headset in mind. The repositioning of the 13mm ultrawide camera and the telephoto camera was specifically done to enable the shooting of stereoscopic or spatial video.
Capturing the spatial effect is not simply a matter of shooting slightly different angles of the same scene through both lenses. Apple’s computational photography must crop and scale the ultrawide video to match the frames coming from the main camera. In turn, these spatial videos can only be edited using basic trimming features. However, the seamless synchronization between the two video streams makes the overall experience of capturing and viewing spatial videos on the iPhone 15 Pro truly unique.
A few media professionals had the opportunity to test out the spatial video capture feature after downloading the iOS 17.2 public beta. The process was described as straightforward; after enabling the spatial video option under Camera/Formats in the Settings menu, users can select the Vision Pro icon to enter Spatial Video mode. Capturing the spatial video requires holding the iPhone in landscape orientation and watching the optional image level tool to ensure the best results.
Shooting the video itself reportedly felt no different from the usual video capturing experience, despite the complicated computational processes taking place in the background. Once recorded, the spatial videos can be instantly played back and viewed on the Vision Pro, a mixed reality device featuring gaze, gesture, and Digital Crown-based controls. The ability to manipulate images through gaze and finger taps felt intuitive and immersive—it allowed for a level of detail and interaction previously unseen on other devices.
The Vision Pro headset has been designed to offer a fully bespoke experience, from tailored prescription lenses to adjustable headbands. New controls introduced since the headset’s initial preview expressed an evolution of accessibility and usability, demonstrating Apple’s commitment to innovation and user experience. Overall, the integration of spatial video along with the Vision Pro headset redefines the future of video capabilities and immersive content consumption. Iconic panoramas and breathtaking landscapes come to life in this futuristic visual experience.
The arrival of spatial video capabilities on the iPhone 15 Pro marks a significant step forward in content creation and consumption. Users are encouraged to embrace this new video format, which is poised to revolutionize the way we capture and immerse ourselves in content both on our devices and on the upcoming Vision Pro headset.
