Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

YouTuber Explains How to Watch Spatial Videos From iPhone 15 Pro on VR Headsets

New question from a 3D fan. The post suggests I can view these new 3D files on A 3D TV. I have that, but how do I get the video into it? Through an Apple TV, on some setting that doesn’t current exist? Directly from the phone? Can I edit the files, say in iMovie or Final Cut? And will there be a way, when the Vision Pro comes out, to view 3D blu-ray disks on it?
 
  • Like
Reactions: centauratlas and t0pher
OnePieceIsReal said:
Quest 3 and pro has lenses than you can record in 3d too just for apple spatial is using 2 lenses one wide and one I would consider standard maybe 35-50mm focal distance . The one cool factor of spatial video is that it lets you look slightly around the subject but in reality it’s just stitching two videos together and giving a window to see corner areas of the rest of the wide lens
Click to expand...
That didn’t answer my question. I’m talking about playback experience and you’re talking about capturing the video itself I think?
 
NT1440 said:
That didn’t answer my question. I’m talking about playback experience and you’re talking about capturing the video itself I think?
Click to expand...
Well there are few headsets that have eye tracking like oculus pro big screen vr and a few other headsets . Foveated rendering is used to save performance it blurs areas your eyes aren’t looking at and keep high resolution where you look at . Latest headset to do this is psvr2
 
Filmed some videos with my iPhone 15 max and watched them back on the oculus pro. The videos are quite good looking, they look better than any 3d video I’ve watched in other apps. Feels like there is really good depth and clearer than I would have thought.
 
  • Like
Reactions: anticipate
zach-coleman said:
I can’t find the way to actually export the video besides in side by side or top/bottom in the TestFlight app. Is it just me?
Click to expand...
You export it in side by side mode, then I added the video to the quest with sidequest and then watched it with deoVR and switch the video format to side by side. That worked for me
 
revdlc said:
New question from a 3D fan. The post suggests I can view these new 3D files on A 3D TV. I have that, but how do I get the video into it?
Click to expand...
Google for "SBS 3D", that’s probably the easiest way. It's a regular 2D video format where each frame contains the left and right-eye picture side-by-side. 3D TVs can usually play that when switching them into 3D mode (consult your TV manual). You'll need to find out how to convert Apple's MV-HEVC format to SBS (probably on a Mac).

revdlc said:
Through an Apple TV, on some setting that doesn’t current exist?
Click to expand...
Unlikely.

revdlc said:
Directly from the phone?
Click to expand...
Very unlikely.

revdlc said:
Can I edit the files, say in iMovie or Final Cut?
Click to expand...
Maybe?

revdlc said:
will there be a way, when the Vision Pro comes out, to view 3D blu-ray disks on it?
Click to expand...
Most unlikely. You'll have to rip the 3DBD and find out how to convert it to MV-HEVC. Apple will want to sell you 3D movies on Apple TV+.
 
  • Haha
Reactions: revdlc
Randompasserby said:
You export it in side by side mode, then I added the video to the quest with sidequest and then watched it with deoVR and switch the video format to side by side. That worked for me
Click to expand...
I found this out in the meantime and got it working. The wording of the app implied there was a special export mode to export in a 3D format or something. A reddit post recommended top/bottom mode, and to end the file name in _TB.mp4 which apparently makes it work smoother. No idea if that's actually needed but it works great! Unfortunately I only have a Quest 2 which as far as I'm aware can't even show me the videos in full 1080p quality...

They still look great though. The first video I took last week ended up as a really good intro, it starts off far from the subject (my cat) before getting really close, and she walks up to the camera and meows, making her face shoot out of the display. It's very cool seeing my own videos this way, and not just like... a Star Wars movie or whatever.
 
Last edited:
XboxEvolved said:
So wait you’re telling me that the non pro version of AVP exist and Meta has been making it for nearly 10 years? Imagine that. Next thing you are going to tell me is they can do 3D porn and other stuff that most of these shut ins will use it for. And it cost like $2000 less at the least? Imagine that. It’s almost like this was a niche category to even attempt in the first place.
Click to expand...

You ok man?
 
  • Haha
  • Like
Reactions: centauratlas and EmotionalSnow
klasma said:
Haha, Apple might unintentionally boost Quest sales that way. :D Interoperability FTW.
Click to expand...
Yupp. This is great news. It means that iPhone owners might not have to buy a Vision Pro to watch their spatial videos.

AR and VR hardware will improve quickly. In Europe we might even be able to buy a decent model, well before VP launch here.
 
  • Like
Reactions: AsarTheGod
OnePieceIsReal said:
This article explains it better https://www.uploadvr.com/iphone-15-pro-spatial-video-released-vision-pro/ basically two lenses stitched together still 3d but has a blurred frame to recreate dof while it works and is nice it’s still basically a 3d video just with the support of looking around simulating 3d objects. Still it will be cool for someone to figure it out fully to let you “look around” the video
Click to expand...

Only way I think that will be possible is with AI to reconstruct any parts of the scene not visible to the camera. Otherwise you’re limited to the difference in view between the two cameras.


It sounds like VR180 is starting to make a comeback as a result of the Vision Pro and new Meta Quest. Canon already has a lens out for their RF mount cameras and they’ve announced a new stand alone camera which sounds a lot like a modern Insta360 Evo, which is a really good thing as it was excellent at this 4 years ago.

This will really be 3D in the Home’s 3rd attempt at a coming out in the past couple of decades, so I’d take all the hype with a grain of salt: Post HDTV was all about 3DTV. I remember going to NAB in Las Vegas in 2011 or 2012… all the major broadcast players were showcasing Steroscopic 3D (cameras, video switchers, entire fleets of 3D broadcast trucks ready for sporting events) and everyone thought it was the next thing until consumers didn’t buy into the hype.

In 2017/2018 there was a big push into 3D again because of VR and even things like Google Cardboard, but that didn’t take off either.

If Vision Pro and Quest 3 get enough people interested in watching and creating 3D content again, there is a lot of mature tech ready and ripe to be improved on.
 
Apple will find a way to block this from being able to work on other AR/VR headsets because they will want to make sure that it only works on the Vison Pro (when it comes out). For now it is not a problem because the Vison Pro has not been released yet but when it does Apple will want to make sure people buy the Vision Pro to watch spatial videos and not a competitors cheaper headset.
 
laptech said:
Apple will find a way to block this from being able to work on other AR/VR headsets because they will want to make sure that it only works on the Vison Pro (when it comes out).
Click to expand...
Apple could get away with that behaviour during the Steve Jobs era. However we don't live in 2010 any longer and Apple is less of a walled garden today.

The iPhone now has USB-C, SSD support and side loading apps will be possibility next year. I don't think they will block users from accessing their spatial videos through 3rd party headsets.
 
  • Like
Reactions: AsarTheGod
klasma said:
Google for "SBS 3D", that’s probably the easiest way. It's a regular 2D video format where each frame contains the left and right-eye picture side-by-side. 3D TVs can usually play that when switching them into 3D mode (consult your TV manual). You'll need to find out how to convert Apple's MV-HEVC format to SBS (probably on a Mac).


Unlikely.


Very unlikely.


Maybe?


Most unlikely. You'll have to rip the 3DBD and find out how to convert it to MV-HEVC. Apple will want to sell you 3D movies on Apple TV+.
Click to expand...
I have an older Panasonic 1080p 3dtv with 3d glasses and am wondering his if get 3d footage on it from the phone.

Must be a trivial way if the article has mentioned 3d.
 
  • Like
Reactions: centauratlas
revdlc said:
New question from a 3D fan. The post suggests I can view these new 3D files on A 3D TV. I have that, but how do I get the video into it? Through an Apple TV, on some setting that doesn’t current exist? Directly from the phone? Can I edit the files, say in iMovie or Final Cut? And will there be a way, when the Vision Pro comes out, to view 3D blu-ray disks on it?
Click to expand...
I have lot of 3 D SBS content. I use Air Video HD app, they don’t update any more to AirPlay from my phone to Apple TV. It’s the easiest way to get the 3D content from my phone to TV. On the TV, there should be a setting to convert SBS format to 3D.
 
I have a Quest 3 - Apple has media/productivity tasks in the bag with Vision Pro. Just watching a youtube video on the Q3 is such a hassle - first, you can't use the YouTube app unless you want 480P. Then you open the browser, go to youtube, find a video, tap play, then try to tap the full screen button but you will miss 75% of the time and instead hit the playback bar to scroll to the end of the video. So then you hit the start of the playback bar a few times as it usually doesn't actually work. Then you get it into fullscreen finally, but need to reposition the window because the fullscreen view is huge and usually gets sunken into the wall in front of you. But you can't move it with your hands (Because...they just didn't implement it?), so now find a controller to move it into position. Now 10 minutes later, you can play your 2 minute youtube video.

Oh yeah - and if it is side by side 3d, then you have to change into that mode. And the playback controls are rendered normally, so if you are "hovering" over the video you are going to get some uncomfortable depth perception issues because the video is 3d, but the controls are 2d overlaid on top of that.

A lot of these issues are just because hand tracking is still "beta", but I think in reality the problem is Meta started out as a VR, controller only headset designed for gaming and now are trying to quickly transition to being an MR, hand controlled system designed for productivity.

I've watched the iPhone SBS videos...but so far they haven't been great. I don't think the iPhone recording is the problem though.
 
  • Like
Reactions: zach-coleman and anticipate
Macalicious2011 said:
Apple could get away with that behaviour during the Steve Jobs era. However we don't live in 2010 any longer and Apple is less of a walled garden today.

The iPhone now has USB-C, SSD support and side loading apps will be possibility next year. I don't think they will block users from accessing their spatial videos through 3rd party headsets.
Click to expand...

I suspect the poster you’re replying to is correct. Apple is likely to lock this down.
 
Surf Monkey said:
I suspect the poster you’re replying to is correct. Apple is likely to lock this down.
Click to expand...
As long as files can be dragged out of iCloud Photos on a Mac and be recovered as a raw file, there is no real way they could ever prevent you from doing this. Spatial videos are going to have support for editing in Final Cut so they can’t just completely lock them from being modified with some encryption key.

I will say though, if Apple is at all serious about MR catching on, they will make it *easier* to view their videos on other headsets, not harder.
 
  • Like
Reactions: Macalicious2011
jclardy said:
I have a Quest 3 - Apple has media/productivity tasks in the bag with Vision Pro. Just watching a youtube video on the Q3 is such a hassle - first, you can't use the YouTube app unless you want 480P. Then you open the browser, go to youtube, find a video, tap play, then try to tap the full screen button but you will miss 75% of the time and instead hit the playback bar to scroll to the end of the video. So then you hit the start of the playback bar a few times as it usually doesn't actually work. Then you get it into fullscreen finally, but need to reposition the window because the fullscreen view is huge and usually gets sunken into the wall in front of you. But you can't move it with your hands (Because...they just didn't implement it?), so now find a controller to move it into position. Now 10 minutes later, you can play your 2 minute youtube video.

Oh yeah - and if it is side by side 3d, then you have to change into that mode. And the playback controls are rendered normally, so if you are "hovering" over the video you are going to get some uncomfortable depth perception issues because the video is 3d, but the controls are 2d overlaid on top of that.

A lot of these issues are just because hand tracking is still "beta", but I think in reality the problem is Meta started out as a VR, controller only headset designed for gaming and now are trying to quickly transition to being an MR, hand controlled system designed for productivity.

I've watched the iPhone SBS videos...but so far they haven't been great. I don't think the iPhone recording is the problem though.
Click to expand...
They’re so many years into the Quest now and the UI is still extremely dire. I don’t think people understand how much better the Vision Pro really is going to be. Doing anything in a quest is like pulling teeth.

Sometimes (at least once every time I use it) even if you point with the controller and click it will make a sound like you clicked but nothing happens. Somehow they haven’t fixed that after all these years.
 
zach-coleman said:
They’re so many years into the Quest now and the UI is still extremely dire. I don’t think people understand how much better the Vision Pro really is going to be. Doing anything in a quest is like pulling teeth.

Sometimes (at least once every time I use it) even if you point with the controller and click it will make a sound like you clicked but nothing happens. Somehow they haven’t fixed that after all these years.
Click to expand...
The interface/interactions appear to be much more refined and user friendly on VisionPro, but that’s primarily enabled by the eye tracking. It’s something that Meta could easily duplicate if they include eye tracking as well, but that’s also part of the high cost on VP.
Apple’s decision to only go with hands/eyes as controls and not include controllers limits the kinds of experiences you can have, though. You cant play games like Beat Saber or Assassins Creed without physical VR controllers. Sure, someone could release 3rd party versions, but that would make the ecosystem a mess and wouldn’t have good support from developers.
Windows has arguably been the clunkiest OS for decades, but it’s still the most mass-adopted OS, and the OS people use for gaming. Apple is going to have to perform a miracle to get any kind of mass adoption at a $3500 starting point
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back