Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Head Tracking Allows Glasses Free 3D on iPad

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
68,198
38,988




MacStories points to an interesting use of the iPad's front facing camera to provide a convincing 3D effect on the iPad. Jeremie Francone and Laurence Nigay from the Laboratory of Informatics of Grenoble put together this demo video showing how user tracking can be used:We track the head of the user with the front facing camera in order to create a glasses-free monocular 3D display. Such spatially-aware mobile display enables to improve the possibilities of interaction. It does not use the accelerometers and relies only on the front camera. Francone and Nigay were inspired by the work of Johnny Lee who built a similar system using a Wii system. The app does not yet appear to be available for download. We had previously reported that Apple was also exploring this type of 3d "hyper reality" displays for the Mac desktop based on a patent application published in 2009.

050903-look3_500.jpg
The user could then move their head left and right to look around a 3D object as shown in the example image above. Apple also suggests that it could also be applied to 2D objects like windows to provide some added depth to traditionally flat objects.As with all patent applications, we don't know if Apple will ever deliver these technologies to market, but 3D has become a trendy topic once again, so there's been a lot of renewed interest in this field.

Article Link: Head Tracking Allows Glasses Free 3D on iPad
 
Article Link
https://www.macrumors.com/2011/04/11/head-tracking-allows-glasses-free-3d-on-ipad/
Consultant said:
Can also use the gyro / accelerometer to do it, but cool idea.
Click to expand...

The demo shows both. The gyro/acceleration works when the iPad is moving and the head is still. The head tracker adds to the effect when the iPad is still and the head is moving. The combination should be quite nice.
 
There are already some apps that do this subtly using other techniques.

'Labyrinth LE' is one that I know of right now, but it's just a way to make it look cooler. The gameplay doesn't depend on it. I look forward to seeing others push the limits like this. That one works when you move the iPad...this head-tracking one has the advantage of being able to leave the iPad on a table while you only move your head.

This could lead to some amazing games, like maybe one where you control something on the iPad with your iPhone as the controller and the screen on the iPad 'moves' based on how you move your head. You could literally look 'around' objects in the game while it sits propped up on a table in front of you.

Looks awesome!
 
Pretty cool.

Gamers would like this and I can see other applications utilizing this capability. Interesting to see how it develops.
 
This 3D tech is not as cool as it looks in these videos. Both your eyes receive the same image, so your brain knows its not 3D. Nothing will look like its "popping" out of your screen at you.
 
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.
 
ventro said:
This 3D tech is not as cool as it looks in these videos. Both your eyes receive the same image, so your brain knows its not 3D. Nothing will look like its "popping" out of your screen at you.
Click to expand...

Well, considering that nothing is "popping" out of Youtube at me right now I'd say that it'll be exactly like it looks in these videos!
 
Ruahrc said:
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.
Click to expand...

Plus this has been done on the DSi before.

Still neat.
 
I'd be all for something like this. Normal 3D displays are useless to me, I have an eye condition that doesn't allow me to see 3D. So I should at least have SOME 3D fun.
 
That is way cool! Probably some practical issues (like how to not block the camera while you are flipping it around), but it looks really effective with no glasses, I'm impressed.
 
Ruahrc said:
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.
Click to expand...

I find it a bit of a stretch to say one kind of optical illusion is "real 3D" while another optical illusion is "not really 3D."

I get that they're different and I understand their strengths and weaknesses (really I do) but let's not forget that they're ALL just illusions of 3D space stuck to a 2D plane.

diamond.g said:
You don't have depth perception?
Click to expand...

I dunno what his deal is, but my mother-in-law only has one working eye. These things are neat for her because she can see them whereas she can't experience the traditional glasses-based kind at all.
 
Wirelessly posted (Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_3_1 like Mac OS X; en-us) AppleWebKit/533.17.9 (KHTML, like Gecko) Version/5.0.2 Mobile/8G4 Safari/6533.18.5)

wish I lived in a 1D world so i could appreciate it more...;-0
 
Wirelessly posted (Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_2_1 like Mac OS X; nl-nl) AppleWebKit/533.17.9 (KHTML, like Gecko) Version/5.0.2 Mobile/8C148a Safari/6533.18.5)

Nice!

But isn't it gonna be al messed up when there're other persons looking over your shoulder?
 
Small White Car said:
There are already some apps that do this subtly using other techniques.

'Labyrinth LE' is one that I know of right now, but it's just a way to make it look cooler. The gameplay doesn't depend on it. I look forward to seeing others push the limits like this. That one works when you move the iPad...this head-tracking one has the advantage of being able to leave the iPad on a table while you only move your head.

Looks awesome!
Click to expand...

iHologram (the paid app, not the unrelated free one) is an interesting proof-of-concept for a sensor-driven 3D effect that actually appears to extend out of the screen in the right environment, though again it doesn't monitor the viewing angle.
 
suneun said:
The demo shows both. The gyro/acceleration works when the iPad is moving and the head is still. The head tracker adds to the effect when the iPad is still and the head is moving. The combination should be quite nice.
Click to expand...

"It does not use the accelerometers and relies only on the front camera."
 
diamond.g said:
You don't have depth perception?
Click to expand...

Nope. I mean I can look at something and gauge how far away it is, but as far as proper depth perception I don't.

Basically because of my condition (Duane's Retraction Syndrome) my brain only processes images out of one eye (although I see out of both.) Therefore any stereoscopic 3D effect is lost on me.
 
diamond.g said:
You don't have depth perception?
Click to expand...

Quite a few people don't have good depth perception, or none at all.

People with unequal strength eyes will oftentimes grow up without much depth perception, to no ill effect.
 
Small White Car said:
I find it a bit of a stretch to say one kind of optical illusion is "real 3D" while another optical illusion is "not really 3D."

I get that they're different and I understand their strengths and weaknesses (really I do) but let's not forget that they're ALL just illusions of 3D space stuck to a 2D plane.
Click to expand...

That's correct, neither is "real 3d"

One is stereoscopic 3d, and one is not.
 
The Nintendo 3DS is really fun....

Wow - yet another reason for an iPad 2 over the original..

Any chances for a Touch/iPhone version?

Or, any device with a front camera/gyro/accelerometer?
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back