Apple's AI Smart Glasses Likely to Support Hand Gesture Controls

[MacRumors]

Apple is developing a set of AI smart glasses to rival products like the Meta Ray-Bans, and MacRumors has learned a few more details about Apple's work on the device from an inside source.

The AI glasses will include two cameras. A high-resolution camera will be included for capturing photos and videos that can be shared on social media and used like iPhone photos. A second lower-resolution wide-angle lens will read hand gestures and provide visual input for Siri.

Apple uses hand gesture-based input for the Vision Pro, and rumors suggest the AirPods Pro will be updated with low-resolution cameras and support for gestures as well. Apple appears to be leaning into gesture support, and it's an ideal input method when no screen is available to interact with.

While future versions of the smart glasses could include an integrated display for augmented reality features, the first version will have no display at all. Apple will not include a screen, LiDAR, 3D cameras, or other similar technology because such features are too energy-intensive.

Battery life is a major constraint because Apple needs to keep the glasses slim and lightweight. Battery size is the bottleneck behind the hardware decisions that Apple is making, and it's why Apple is opting for a stripped-down feature set.

According to recent rumors, Apple is testing multiple styles for the smart glasses, with plans to use acetate. Acetate is a lightweight plant-based material that's more flexible than plastic.

Apple's smart glasses will incorporate the smarter version of Siri that Apple plans to introduce in iOS 27. The device will be able to take photos, record video, and make phone calls, plus users will be able to interact with Siri to ask questions about what's around them. The feature set will be similar to the features available in the Meta Ray-Bans that Apple is aiming to compete with.

Rumors suggest Apple could preview the glasses later this year, with a launch to follow in 2027, though it's also possible we won't see them announced until 2027.

Article Link: Apple's AI Smart Glasses Likely to Support Hand Gesture Controls

 

[Black Magic]

My HSA account is waiting patiently.....

 

[RedWeasel]

Apple's smart glasses will incorporate the smarter version of Siri that Apple plans to introduce in iOS 27.

I'm pretty sure this will need an iPhone tether somehow. I can't see how they would run inference on device otherwise.

 

[klasma]

I'm pretty sure this will need an iPhone tether somehow. I can't see how they would run inference on device otherwise.

Yes, it will support smarter Siri in a similar fashion to how the Apple Watch will support it.

 

[sw1tcher]

Better price it right, have plenty of apps for it, and present a good use-case for it otherwise it'll flop like the Vision Pro

 

[terminator-jq]

This is just step one. Fast forward a few more years and we’ll have:

1. Smart Glasses (camera, audio, microphone)

2. Smart Glasses with Display (adds single HD display for health metrics, directions and other simple smart features). The tech is already ready for this one.

3. Spacial Glasses (Runs full Vision OS, dual 4K displays, may use small puck for computing and battery, auto tinting glass and optional magnetic attachments for fully immersive content).

Tech in these segments is moving very quickly. Googles Aura prototype shows the current upper limits. I’m looking forward to seeing how Apple completes in this space under the new CEO.

 

[Apple Knowledge Navigator]

Gestures, huh? I gotta hand it to them!

 

[CalMin]

While I can see a use for AVP (I personally enjoy VR over AR) Smart Glasses have never made sense to me. It seems we are searching hard for the solution to a post-smartphone era, but why? Phones are small, convenient, feature packed.

I now have to wear reading glasses in certain situations, but I remove them whenever I can. Why would I want a computer perched on my nose?

 

[RedWeasel]

Better price it right, have plenty of apps for it, and present a good use-case for it otherwise it'll flop like the Vision Pro

Apps? Without some form of display?

 

[b.williams]

Better price it right, have plenty of apps for it, and present a good use-case for it otherwise it'll flop like the Vision Pro

Non-starter

 

[Unregistered 4U]

Switch 1 cameras in your ear 🙂

 

[sw1tcher]

Apps? Without some form of display?

This is suppose to have a smarter (AI-enhanced) version of Siri:

Apple's smart glasses will incorporate the smarter version of Siri

The user instructs Siri on what to do with the apps

 

[Unregistered 4U]

While I can see a use for AVP (I personally enjoy VR over AR) Smart Glasses have never made sense to me. It seems we are searching hard for the solution to a post-smartphone era, but why? Phones are small, convenient, feature packed.

I now have to wear reading glasses in certain situations, but I remove them whenever I can. Why would I want a computer perched on my nose?

Smart glasses are for folks that want to remove themselves from conversations. The model listens and provides a response for the user to read out. The next innovation will be when it can also speak for them. 🙂 Maybe the rumored AirTag device is just a speaker!

 

[klasma]

[apps]

“the first version will have no display at all”

I don’t think Apple will provide for audio-only apps.

 

[lepetitnicolas]

I guess the spirit of the Vision Pro will live in the next glasses....

 

[Rychiar]

if they wait til 2027 they better have a display

 

[switz]

Not really wanting these glasses that continuously feed NSA my every spoken thought, what I look at and where I am located.

We are nearly there for thought police and camps to "correct" one's thinking.....

 

[Mr_Ed]

While future versions of the smart glasses could include an integrated display for augmented reality features, the first version will have no display at all. Apple will not include a screen, LiDAR, 3D cameras, or other similar technology because such features are too energy-intensive.

Then why bother releasing it? Oh, I know . . .

“They will iterate and make it better yadda yadda . . . .”

Iterate in the freaking internal labs until you have something with practical uses consumers will think they really want. Did they really not learn this from the AVP?

 

[sflagel]

No one wants people with spy cameras running around.