'i3D' Demo App Shows Off Head-Tracking 3D on iOS Devices

Discussion in 'MacRumors.com News Discussion' started by MacRumors, May 23, 2011.

  1. macrumors bot


    Apr 12, 2001

    Last month, French researchers Jeremie Francone and Laurence Nigay posted a video showing off a method for using head tracking by a device's camera to simulate three-dimensional scenes for the iPad, a concept in which Apple has expressed some interest.


    As noted by MacStories, a new demo app from Francone and Nigay known as i3D has appeared in the App Store, giving users the opportunity to test out the technology on their own devices.

    i3D is a free universal app running on the iPad 2, iPhone 4, and fourth-generation iPod touch. It contains a sample video image displaying a bounding box as it tracks the user's head location, as well as five demos showing the simulated 3D perspective that can be generated using the tracking.

    Article Link: 'i3D' Demo App Shows Off Head-Tracking 3D on iOS Devices
  2. macrumors newbie


    Aug 31, 2010
    mm Cool hope the next idevices get this integrated already
  3. macrumors 6502a


    Aug 7, 2008
    Cool concept... but it doesn't work very well yet..
  4. macrumors 604


    Nov 26, 2007
    I wonder if a free API for this will be released... I can think of some cool features it could be used for in a game...
  5. macrumors 6502a

    Oct 23, 2007
    The problem is as soon as you get somewhat out of view of the camera it doesn't work right. It's a cool concept but in the real world probably wont go anywhere.
  6. macrumors 6502a


    Jun 22, 2006
    Just downloaded this for my iP4. Some demos work better than others - and overall it is a bit jerky. I don't think the head tracking is quite right yet. Very promising though -it will be so cool when it's perfected.
  7. macrumors member

    Apr 20, 2010
    Good start - but we're still several years away.
  8. macrumors 68000

    Aug 20, 2009
    Preston, UK
  9. macrumors newbie

    May 23, 2011
    fake vid?

    I just want to know how it works when no one is touching the ipad.. I can understand the technology with the accelerometer in place.
  10. macrumors 68000


    May 28, 2008
  11. macrumors 6502a

    Sep 21, 2009
    It is a bit smoother in the video than in real life but I think these researchers deserve a lot of credit. It's quite good for a proof of concept research project.
  12. macrumors member


    Apr 26, 2010
    Long Island, NY
    I've been so excited to try out this head tracking 3D, and after playing with this app for a few minutes I'm so underwhelmed. It doesn't feel anywhere near as cool as I expected it to. Maybe it will be better with some more development, but I'm definitely let down.
  13. macrumors 601


    Feb 19, 2008
    Famous last words.
  14. guzhogi, May 23, 2011
    Last edited: May 23, 2011

    macrumors 68020


    Aug 31, 2003
    Wherever my feet take me…
    Just downloaded it and I have to agree - very cool stuff, but still needs a lot of work.

    Actually, it doesn't use the accelerometer. According to the article, it uses the front camera to track where your head is in relation. Because of that, there's no need to touch the iPad.
  15. macrumors 68020


    Jan 22, 2009
    Thanks for the concern, chief, but read the article/watch the video. It's not a "fake vid."
  16. macrumors member

    Apr 16, 2011
    fun for a demo

    This is basically a demo to show as a proof of concept. It will only get better with time but it was still fun to play with. Given the fact that Apple has shown some interest, perhaps there will be a future product that will support this better.
  17. macrumors P6

    Jun 22, 2009
    Cool in concert. Not nearly ready for prime time obviously.

    The demo was "neat" - but kludgy at best
  18. macrumors G4

    Small White Car

    Aug 29, 2006
    Washington DC
    I think the current problem is that it seems to rely on ONLY the video camera. I think this accounts for a lot of the jerkiness and lag.

    I suspect this technology will get much better once it starts using more iPhone sensors in tandem. Imagine if it worked by accelerometer and gyroscope and only used the camera to re-calibrate every half second or so. Then it won't be as big a problem when the camera loses you for a second.

    I think they'll get there. Apps like MotionX-Dice already use a basic form of this trick using only the accelerometer. Once they make this better you'll see it spread to more and more apps.
  19. macrumors 6502a


    Oct 4, 2010
    Bristol, UK
    Not bad for a proof of concept.

    After trying it on my iPad 2 and iPhone 4, it seemed to work better and feel more natural on the iPhone.

    Just an afterthought.. although the suggestion of 3D using this technique is cool, is it really that useful on a device which (in my case at least) is always held in the same position relative to the face? Would be interesting to see how something like this works on a desktop. Does a similar thing exist for Mac using the iSight camera..?
  20. macrumors newbie

    Jan 6, 2011
  21. macrumors G4


    Feb 5, 2009
    It's experimental at this point.
  22. macrumors newbie

    May 23, 2011
    Will be nice to manipulate some excel presentations :cool:
    What is the music from ??
  23. macrumors 6502

    Jul 10, 2010
    Brooklyn, NY
    Great concept and a decent first attempt. If in the future iDevices get wide angle front facing cameras this could really be a great feature. Till then, congrats to the makers!
  24. macrumors 6502


    Apr 19, 2004
    Nottingham, UK

    Sure, it needs a small amount of work but WOW, unlike most others I was very impressed!

    Looking forward to this being introduced into iOS and apps real soon!
  25. macrumors 68030


    Oct 6, 2008
    This is a cool demo but I don't see the tech going anywhere.

    The problem is when you use a device like iPad or iPhone is that you would have to be aware of it all the time. If you have your ipad on a table and go to touch the screen your camera angle will change because your hand will probably block the camera.

    And of course the iPad front facing camera is not very wide angle so once you move out of bounds it can no longer track you.

    It might be a neat trick for games or a little bit useful in a 3d modeling app (to peek around the side I guess...still not that useful.) but I don't see it being used in anything other than that.

    The extra processing power required for head tracking plus switching to a 3d interface wouldn't be worth the small benefit that the "3d" would allow.

    IMO 3D will remain a gimmick until we can interact with our computers in 3 dimensions (Mouse: 2d, trackpad: 2d, touchscreen: 2d). That and we have displays that allow multiple people to see the effect without glasses.

Share This Page