Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
68,701
39,619


With the launch of iOS 17.2, Apple added a camera feature that allows iPhone 15 Pro and iPhone 15 Pro Max models to record 3D spatial video that will be viewable on the Apple Vision Pro when it becomes available for purchase.

spatial-video-apple-visioin-pro.jpg

To demonstrate the feature, Apple this week invited several members of the media to record spatial video with their iPhones and then view it on an Apple Vision Pro headset. Those who were able to experience their videos in 3D have now written about the experience and what it's like using the Vision Pro for reliving memories.

CNET's Scott Stein found that videos of his family members were the most compelling, and a recording of his mother in particular seemed to make eye contact and made him feel like he was "almost there." In video with a lot of motion, the 30 fps limit was noticeable, though less so in videos with less motion. HDR photos "looked great," with Stein saying they appeared as good as or better than on a Mac or a TV, with HDR that "popped" and options to zoom in.
I also got a kick out of seeing some of my favorite exhibits at the Museum of Natural History in 3D. I went to the Hall of Ocean Life, where a trio of little tanks on the top floor house dioramas of prehistoric sea creatures that I've loved since I was a kid. I captured the ammonites and trilobites, gliding from case to case. In 3D on Vision Pro, it felt like a little home diorama revisited. I could see the joy of capturing little immersive installations, or spaces, that aren't easy to go back to, and having them in front of you again.
TechRadar's Lance Ulanoff said that he was "startled by the quality and immersive nature" of panoramic images that he had captured, and the wider view showed him details he had not seen before. A video of a model train looked like it would "ride right into [his] lap." Compared to standard videos, Ulanoff said the videos "felt more real" and resulted in heightened emotions. He said the level of emotion that can be experienced from family videos in 3D "can be quite intense."

Inverse's Raymond Wong said that spatial videos "feel alive" because of the way the border becomes "glowy and dream-like" when looked at, giving the content the "characteristics of a memory." In a spatial video of his mom, he says he was transported back to the moment, and it was "surreal" to see his mom "talking, laughing, and eating in spatial video."

Wong said that spatial videos can "look life-sized" at a certain distance and window size, but even zoomed out, he felt emotional seeing his mother in 3D.
I think Apple was right in suggesting I capture sentimental content in spatial video. Cool as it was to see my colleagues at the office and a bar with a little bit of the third dimension, I don't think rewatching those clips had the same impact on me as the ones of my family. I suspect once people have the opportunity to see their own content in Vision Pro, they'll get a better sense of when and when not to tap the spatial video icon in the camera app on their iPhones.
Josh Rubin of Cool Hunting said that even in recordings where he was warned there wasn't enough light, the video on the headset was "crisp and not grainy." He found that the best scenes had multiple focal points in a two to eight foot range. Too much movement in a spatial video can be disorienting, leading to nausea.
Shots with the camera stationary (such as on a tripod) are ideal, but camera movement is often necessary or desired to make a satisfying story. I found that recording linear and gently curved movements, especially in open spaces, created videos that were easy to view. By contrast, sharp turns in close quarters created more jarring videos.
The Vision Pro headset is set to launch in early 2024, and Apple is hoping that customers who plan to buy it will have a selection of their own spatial videos ready to go when it comes out. Spatial video can be recorded right now on the iPhone 15 Pro and iPhone 15 Pro Max, though the captured video will look normal until viewed in 3D on the Vision Pro headset.

Article Link: Journalists Detail Seeing Their Own Spatial Videos on Apple Vision Pro
 
  • Love
Reactions: SFjohn
I just tried a couple of iPhone Spatial videos on my Quest 3. Honestly pretty surreal in a cool way. You’ve probably seen 3D images and movies before, but it’s wild seeing your own pets in 3D in front of you.

And I’m sure it’ll look much better on AVP.
 
I just tried a couple of iPhone Spatial videos on my Quest 3. Honestly pretty surreal in a cool way. You’ve probably seen 3D images and movies before, but it’s wild seeing your own pets in 3D in front of you.

And I’m sure it’ll look much better on AVP.
So the files are cross compatible?
 
I fail to see the utility of this at the moment. Right now, you could only possibly see spatial video on an expensive device.
You can convert videos and watch them on any VR headset. Probably possible to use Google Cardboard if you wanted.
 
  • Like
Reactions: Jack Burton
I fail to see the utility of this at the moment. Right now, you could only possibly see spatial video on an expensive device.
Agree. While I think this is cool, I'm glad I bought the 15 and saved $200 over the 15 pro because no way in the world I'm going to be buying a $3500 VR set.
 
I have no intention of buying a first gen AVP, but I'll probably start to get in the habit of recording some AVP video on my 15PM, especially with holidays coming up. That way, if/when I get a future generation of Apple Vision, I'll be able to look at some memories from years before in spatial video. :)
 
Would be great to try. Sadly far out of reach for most people. Ridiculous pricing. Would love a go of these, maybe if I sell my car! Thanks Tim! 🙄
Everyone keeps saying this is ridiculously priced. Everything in it is new top of the line tech. It is far above any other VR device sold and is essentially a full-blown MacBook as well.
 
This is Apple preparing the future for Vision Pro. Although I do think it’s interesting, it still feels a bit premature since the product isn’t even on the market yet. If the Vision Pro is going to succeed, then it’s going to take at least a decade to become first stage mainstream.
 
  • Haha
Reactions: Misterioso
While we can quibble about the execution of the headset and the price of entry, the value of a spatial video is underrated.

Maybe you’re fortunate enough not to have experienced loss in your life, but I’ll be taking quite a few spatial videos now because I know I will want these memories later.

I’ll take these videos because one day these will be my only remaining memory of people and pets I love. Fortunate to have my parents with me today in their 80s - I will be taking a lot of spatial videos with them herein.

4K video will still have a place but add some depth to a few clips and I’m convinced I’m going to always come back to those in the future just to relive a few moments.
 
While we can quibble about the execution of the headset and the price of entry, the value of a spatial video is underrated.

Maybe you’re fortunate enough not to have experienced loss in your life, but I’ll be taking quite a few spatial videos now because I know I will want these memories later.

I’ll take these videos because one day these will be my only remaining memory of people and pets I love. Fortunate to have my parents with me today in their 80s - I will be taking a lot of spatial videos with them herein.

4K video will still have a place but add some depth to a few clips and I’m convinced I’m going to always come back to those in the future just to relive a few moments.

Thinking the same thing...I'll definitely be taking spatial videos of my family over Christmas. I don't plan on buying the Vision Pro, but no harm in making the videos now for watching on the future Vision non-Pro.
 
I fail to see the utility of this at the moment. Right now, you could only possibly see spatial video on an expensive device.
Because in 5yrs time when you buy the Vision Pro equivalent of the iPhone 4 that’s affordable and mass market you’ll have 5 years of spatial videos to be view of your family, friends, loved ones present and past.
 
Would be great to try. Sadly far out of reach for most people. Ridiculous pricing. Would love a go of these, maybe if I sell my car! Thanks Tim! 🙄
It’s as many virtual displays as you like without taking up any space whatsoever, and you can bet that the internals and app availability are going to take off fast. I’m seriously considering it for work from home instead of a studio display(s).
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.