Become a MacRumors Supporter for $25/year with no ads, private forums, and more!

Head Tracking Allows Glasses Free 3D on iPad

MacRumors

macrumors bot
Original poster
Apr 12, 2001
50,441
11,827




MacStories points to an interesting use of the iPad's front facing camera to provide a convincing 3D effect on the iPad. Jeremie Francone and Laurence Nigay from the Laboratory of Informatics of Grenoble put together this demo video showing how user tracking can be used:We track the head of the user with the front facing camera in order to create a glasses-free monocular 3D display. Such spatially-aware mobile display enables to improve the possibilities of interaction. It does not use the accelerometers and relies only on the front camera. Francone and Nigay were inspired by the work of Johnny Lee who built a similar system using a Wii system. The app does not yet appear to be available for download. We had previously reported that Apple was also exploring this type of 3d "hyper reality" displays for the Mac desktop based on a patent application published in 2009.

The user could then move their head left and right to look around a 3D object as shown in the example image above. Apple also suggests that it could also be applied to 2D objects like windows to provide some added depth to traditionally flat objects.As with all patent applications, we don't know if Apple will ever deliver these technologies to market, but 3D has become a trendy topic once again, so there's been a lot of renewed interest in this field.

Article Link: Head Tracking Allows Glasses Free 3D on iPad
 

suneun

macrumors member
Feb 5, 2002
80
0
Can also use the gyro / accelerometer to do it, but cool idea.

The demo shows both. The gyro/acceleration works when the iPad is moving and the head is still. The head tracker adds to the effect when the iPad is still and the head is moving. The combination should be quite nice.
 
Comment

Small White Car

macrumors G4
Aug 29, 2006
10,925
1,234
Washington DC
There are already some apps that do this subtly using other techniques.

'Labyrinth LE' is one that I know of right now, but it's just a way to make it look cooler. The gameplay doesn't depend on it. I look forward to seeing others push the limits like this. That one works when you move the iPad...this head-tracking one has the advantage of being able to leave the iPad on a table while you only move your head.

This could lead to some amazing games, like maybe one where you control something on the iPad with your iPhone as the controller and the screen on the iPad 'moves' based on how you move your head. You could literally look 'around' objects in the game while it sits propped up on a table in front of you.

Looks awesome!
 
Comment

BLUELION

macrumors member
Oct 25, 2007
67
0
Pretty cool.

Gamers would like this and I can see other applications utilizing this capability. Interesting to see how it develops.
 
Comment

ventro

macrumors 6502a
Sep 23, 2006
692
0
This 3D tech is not as cool as it looks in these videos. Both your eyes receive the same image, so your brain knows its not 3D. Nothing will look like its "popping" out of your screen at you.
 
Comment

Ruahrc

macrumors 65816
Jun 9, 2009
1,345
0
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.
 
Comment

Small White Car

macrumors G4
Aug 29, 2006
10,925
1,234
Washington DC
This 3D tech is not as cool as it looks in these videos. Both your eyes receive the same image, so your brain knows its not 3D. Nothing will look like its "popping" out of your screen at you.

Well, considering that nothing is "popping" out of Youtube at me right now I'd say that it'll be exactly like it looks in these videos!
 
Comment

diamond.g

macrumors 604
Mar 20, 2007
6,649
544
Virginia
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.

Plus this has been done on the DSi before.

Still neat.
 
Comment

DavidLeblond

macrumors 68020
Jan 6, 2004
2,208
325
Raleigh, NC
I'd be all for something like this. Normal 3D displays are useless to me, I have an eye condition that doesn't allow me to see 3D. So I should at least have SOME 3D fun.
 
Comment

HiRez

macrumors 603
Jan 6, 2004
5,946
1,926
Western US
That is way cool! Probably some practical issues (like how to not block the camera while you are flipping it around), but it looks really effective with no glasses, I'm impressed.
 
Comment

Small White Car

macrumors G4
Aug 29, 2006
10,925
1,234
Washington DC
While a neat technology, it's a bit of a stretch to really call this "glasses-free 3D". Unlike the 3DS, where actual illustion of depth is present, this is just changing the perspective on a rendered 3D object on the screen based on head position. The image that the left and right eye sees are the same, thus no actual "3D" effect.

I find it a bit of a stretch to say one kind of optical illusion is "real 3D" while another optical illusion is "not really 3D."

I get that they're different and I understand their strengths and weaknesses (really I do) but let's not forget that they're ALL just illusions of 3D space stuck to a 2D plane.

You don't have depth perception?

I dunno what his deal is, but my mother-in-law only has one working eye. These things are neat for her because she can see them whereas she can't experience the traditional glasses-based kind at all.
 
Comment

darbus69

macrumors regular
Mar 3, 2009
228
36
Wirelessly posted (Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_3_1 like Mac OS X; en-us) AppleWebKit/533.17.9 (KHTML, like Gecko) Version/5.0.2 Mobile/8G4 Safari/6533.18.5)

wish I lived in a 1D world so i could appreciate it more...;-0
 
Comment

Ulf1103

macrumors 6502
Jan 5, 2011
282
0
Wirelessly posted (Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_2_1 like Mac OS X; nl-nl) AppleWebKit/533.17.9 (KHTML, like Gecko) Version/5.0.2 Mobile/8C148a Safari/6533.18.5)

Nice!

But isn't it gonna be al messed up when there're other persons looking over your shoulder?
 
Comment

NightFox

macrumors 68020
May 10, 2005
2,385
1,900
Shropshire, UK
There are already some apps that do this subtly using other techniques.

'Labyrinth LE' is one that I know of right now, but it's just a way to make it look cooler. The gameplay doesn't depend on it. I look forward to seeing others push the limits like this. That one works when you move the iPad...this head-tracking one has the advantage of being able to leave the iPad on a table while you only move your head.

Looks awesome!

iHologram (the paid app, not the unrelated free one) is an interesting proof-of-concept for a sensor-driven 3D effect that actually appears to extend out of the screen in the right environment, though again it doesn't monitor the viewing angle.
 
Comment

Consultant

macrumors G5
Jun 27, 2007
13,310
32
The demo shows both. The gyro/acceleration works when the iPad is moving and the head is still. The head tracker adds to the effect when the iPad is still and the head is moving. The combination should be quite nice.

"It does not use the accelerometers and relies only on the front camera."
 
Comment

DavidLeblond

macrumors 68020
Jan 6, 2004
2,208
325
Raleigh, NC
You don't have depth perception?

Nope. I mean I can look at something and gauge how far away it is, but as far as proper depth perception I don't.

Basically because of my condition (Duane's Retraction Syndrome) my brain only processes images out of one eye (although I see out of both.) Therefore any stereoscopic 3D effect is lost on me.
 
Comment

smithrh

macrumors 68030
Feb 28, 2009
2,517
1,130
You don't have depth perception?

Quite a few people don't have good depth perception, or none at all.

People with unequal strength eyes will oftentimes grow up without much depth perception, to no ill effect.
 
Comment

DavidLeblond

macrumors 68020
Jan 6, 2004
2,208
325
Raleigh, NC
I find it a bit of a stretch to say one kind of optical illusion is "real 3D" while another optical illusion is "not really 3D."

I get that they're different and I understand their strengths and weaknesses (really I do) but let's not forget that they're ALL just illusions of 3D space stuck to a 2D plane.

That's correct, neither is "real 3d"

One is stereoscopic 3d, and one is not.
 
Comment

gkarris

macrumors G3
Dec 31, 2004
8,288
1,038
"No escape from Reality...”
The Nintendo 3DS is really fun....

Wow - yet another reason for an iPad 2 over the original..

Any chances for a Touch/iPhone version?

Or, any device with a front camera/gyro/accelerometer?
 
Comment
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.