Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
65,674
34,294


Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.

apple-view-concept-right-corner.jpg
Antonio De Rosa concept render​
We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).
Click to expand...
Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.

In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.

Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.
Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.
Click to expand...
Apple is widely expected to launch its first-generation AR-focused device in 2022.

Article Link: Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection
 
Article Link
https://www.macrumors.com/2021/12/08/apple-ar-vr-hand-gesture-interface/
Last edited:
JPack

JPack

macrumors G5
Mar 27, 2017
13,497
26,126
Based on this description, no wonder it's expected to weigh 300-400g and cost $3,000.

Looks like the consumer version of this won't be out until several years later.
 
  • Like
Reactions: amartinez1660 and arkitect
T

The Cappy

macrumors 6502a
Nov 9, 2015
652
1,150
Dunwich Fish Market
My main question is how well it'll work with eyeglasses. I suspect Apple is going to do a good job for people like me... but I would have thought other VR devices would have too... and at least for me they mostly don't.
 
Pakaku

Pakaku

macrumors 68040
Aug 29, 2009
3,268
4,832
If Kinect-like hand gestures are how we interface with this, then I can't say this appeals to me very much...
 
M

munpip214

macrumors 6502a
Feb 21, 2011
895
2,567
The Cappy said:
My main question is how well it'll work with eyeglasses. I suspect Apple is going to do a good job for people like me... but I would have thought other VR devices would have too... and at least for me they mostly don't.
Click to expand...
Custom/adjustable lenses in the device so you won’t have to work with your glasses on.

If these are 3k+ it wouldn’t surprise me if you sent in your prescription.
 
  • Like
Reactions: amartinez1660
J

Jensend

macrumors 65816
Dec 19, 2008
1,448
1,659
The Cappy said:
My main question is how well it'll work with eyeglasses. I suspect Apple is going to do a good job for people like me... but I would have thought other VR devices would have too... and at least for me they mostly don't.
Click to expand...
If it's anything like the image a couple of posts above yours, there will either be a diopter adjustment for each eye, or you'll need to buy custom inserts (or select prescription at time of purchase).
The HTC Vive Flow has diopter adjustments for each eye.

Giving enough room for glasses means a larger, more front-heavy design.
 
J

Jensend

macrumors 65816
Dec 19, 2008
1,448
1,659
I hope they at least have an option for more traditional VR controllers. It's important to have the option of very reliable and accurate positional tracking plus the lack of ambiguity of a digital button press.
 
T

topdrawer

macrumors 65816
Oct 1, 2012
1,159
1,788
munpip214 said:
Custom/adjustable lenses in the device so you won’t have to work with your glasses on.

If these are 3k+ it wouldn’t surprise me if you sent in your prescription.
Click to expand...

so i can't share my glasses or show them off to other people that don't have my prescription?
 
4

44267547

Cancelled
Jul 12, 2016
37,642
42,494
So I look at this like it’s not just a ‘gimmick’ for a ~$3,000 price tag, but could possibly be use for companies for training, for surgeons or auto technicians, and even though from a consumer standpoint, that’s expensive. But from a training benefit to companies, this potentially will be a massive shift in technology that will pay for itself essentially, especially when it will probably be a tool used in the future in continuing education.
 
  • Like
Reactions: amartinez1660
loekf

loekf

macrumors 6502a
Mar 23, 2015
837
579
Nijmegen, The Netherlands
Struggling to see a real use in my real life. HoloLens is used in my company for e.g. helping out people remotely doing repairs. Saves us from flying across the world.

And already wearing glasses.
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom