Apple Vision Pro Supports Virtual Typing, Navigation Through Hand Gestures and Eye Movements

[klasma]

I'm excited to see the ins and outs of how visionOS works. Can screens move with you, rather than be fixed in a position? I like the idea of walking around while I worked or did something. Why does a screen need to be stationary?

Yeah, I was wondering how it will learn the layout of your home, and how accurate that will be.

 

[seek3r]

I'm excited to see the ins and outs of how visionOS works. Can screens move with you, rather than be fixed in a position? I like the idea of walking around while I worked or did something. Why does a screen need to be stationary?

I cant wait to bang my shins on furniture while I stare at my virtual 120" screen

 

[jz0309]

I wonder if the virtual keyboard contains Haptic Feedback. If it does that would be amazing. Otherwise, it's going to feel like you are typing in the air.

no, but if you're willing to spend even bigger bucks - check these guys out: https://haptx.com/

now that combo rocks!

 

[jz0309]

love the concept, not sure how steep the learning curve will be

 

[jz0309]

I'm afraid that's impossible

Yeah typing is gonna feel weird haha

not impossible - expensive though. https://haptx.com/

 

[kkee]

"It will need time to get used to."

That's not what the reviewers said! Quote "even my grandma will love this as it is so intuitive." according to one of the reviewer. I believe his name is Brian Tong.

 

[BobSc]

To all that are complaining about the $3500, take another look at what is in this device. Basically it has the M2 chip and another custom processor. That's like having my 24" iMac built into the device, there is $1800 right there, actually better than my iMac. Then all the custom 4K OLED displays, optical sensors and custom OS to run it all. After seeing all the technology and research and development, I am surprise it doesn't cost more. This is a totally new platform and experience, not another $500 me too product. Who else but Apple has the expertise and financial resources to produce this amazing product?

Totally agree. I can't help but laugh out loud when I read that people will wait until it costs $50 before they consider purchasing.

Can I afford one? Not without putting a dent into my retirement. I am jealous of those who are young enough and wealthy enough to enjoy one of these. Hopefully #1 son will get one and I can try his.

Fortunately, my retirement is doing very well and I'm all set. Years of hard work are paying off with the ability to buy this without batting an eye. Can't wait for 2024 to come.

 

[macguru212]

I'm afraid that's impossible

Yeah typing is gonna feel weird haha

Maybe someday we'll have haptic gloves for this thing!

 

[jimbobb24]

With bluetooth keyboard, I can see it being replacement for multi-screen setup on the go.

But the price needs to come down, otherwise I'm not sure how large is the group of people spending 3500 USD for multi-screen setup on the go with OS similar to iPad (iPadOS seems pretty limited compared to macOS experience).

The current state of the art AR/VR headset is $7000. The Vision Pro exceeds it in nearly every way. It’s price competitive with its class. I agree it will need to come down to be more popular and it’s too rich for my blood.

 

[jmgregory1]

Why? Use the same tools one uses to work on spreadsheet. Apple showed Magic keyboard + trackpad (which likely implies mouse could stand in for track pad). VPro on and get to work in the same way one does now... just with the flexibility for much more screen(s) than any laptop/tablet/phone.

Yeah, I just read that it indeed can connect to trackpad and keyboard, which I know they mentioned, but quickly glossed over during the presentation. It will be interesting to see what benefits it brings to everyday work, beyond making the largest spreadsheet ever.

 

[BobSc]

Maybe someday we'll have haptic gloves for this thing!

Why? They aren't needed. You will know what you are doing without them.

 

[Mansu944]

May take time but that's OK. I remember there were articles to instruct people how to type on the original iPhone I assume this will be the same.

 

[jimbobb24]

“The interface won't be easy to get used to for many” - says who? Most reviewers who have actually had a trial with the device say they got the hang of using it in short order…

I have watched 3-4 reviews of people who used it. All said interface was 1) the best of any AR/VR, and 2) super intuitive and easy to use.

 

[HobeSoundDarryl]

Yeah, I just read that it indeed can connect to trackpad and keyboard, which I know they mentioned, but quickly glossed over during the presentation. It will be interesting to see what benefits it brings to everyday work, beyond making the largest spreadsheet ever.

I wish they would have spent more time on that particular thing too. I'd like some strong confirmation that it works well with a physical keyboard and mouse/trackpad AND that the AR overlay thing works so users can look at the keyboard to see their own hands there and get them in the right spots... or reach over for the mouse and actually see where it is.

I'm sure this will be a topic of reviews and then eventually in store demos will really show this as a real thing or "not quite." For my main attraction to the product, this is a very important capability. I hope it works... and works well.

 

[jimbobb24]

I can’t shake off this feeling that this will be like every headset ever, buy it, put it on, try out all the cool stuff, after some time get bored, throw it somewhere in the corner and never remember to put it on again.

I want to get one as a laptop for work…but I do have a suspicion you could be right. What if you are waiting for a render….normal you get uo and walk to the office to gossip leaving the computer behind. Now its on your Fac…..

 

[jz0309]

Maybe someday we'll have haptic gloves for this thing!

that "someday" is much closer than you think: https://haptx.com/

 

[jimbobb24]

The speakers dont go over your ears….on a plane can everyone else hear you or do you use your AirPods in that case?

 

[seek3r]

Why? They aren't needed. You will know what you are doing without them.

Can you imagine being able to recreate the feel of whatever your favorite keyboard is? and have that portable?

How about actually being able to *handle* 3d objects in AR/VR?

There are definitely uses for haptics.

Doesnt mean they're necessary for this particular device at this particular time, but it's definitely a nice to have

My ideal future for this kind of device would be either glasses about the same size as I normally wear for AR or contact lenses (or direct retinal imaging, which is still in early stages) + a pair of gloves no thicker than, say, driving gloves, that could give haptic feedback.

 

[4odomi]

I know a phone without a physical keyboard was welcomed to save real estate, a watch you can make calls on & dig into health metrics was innovative, but I can’t see 1 practical purpose of this hardware at all, especially at $3,500, other then the “coolness factor” which will evaporate quickly when the monthly bill comes due. $145 per month is especially steep for a 1st generation version.

It's obviously not for you, if you can't see 1 practical purpose 😊

 

[macguru212]

Why? They aren't needed. You will know what you are doing without them.

So when a butterfly lands on your hand, you'll feel it. Or if you touch a wall, you'll know it's there.

 

[segfaultdotorg]

Can't wait for the cheaper iVision Air in a year or so.

 

[jz0309]

Can you imagine being able to recreate the feel of whatever your favorite keyboard is? and have that portable?

How about actually being able to *handle* 3d objects in AR/VR?

There are definitely uses for haptics.

Doesnt mean they're necessary for this particular device at this particular time, but it's definitely a nice to have

My ideal future for this kind of device would be either glasses about the same size as I normally wear for AR or contact lenses (or direct retinal imaging, which is still in early stages) + a pair of gloves no thicker than, say, driving gloves, that could give haptic feedback.

well, those do exist, or soon will - but price wise they're currently professional space, not consumer

https://haptx.com/

 

[jimbobb24]

People who like to draw want a stylus. Incidentally, that's use case for which the headset will be completely useless.

Why? Look at table….make illustrator document on desk, draw on it with “pencil”. I dont understand why that particular use case would be challenging at all.

 

[klasma]

Why? Look at table….make illustrator document on desk, draw on it with “pencil”. I dont understand why that particular use case would be challenging at all.

Precision. Remember how much tech and effort Apple put into the Pencil and the associated iPad panel to make it latency-free and sensitive to the pressure and the angle you hold it on the display, to make it feel like a real pencil? I don’t think it's possible to replicate that with a camera-based system. I also don’t think that the spacial positioning of the virtual pencil strokes would be precise enough. When you draw, you work with a precision of roughly one-tenth of a millimeter. You could do rough doodles, but no artistic drawing.

 

[kc9hzn]

I'm afraid that's impossible

Yeah typing is gonna feel weird haha

No kidding! My hands are already hurting just thinking about the RSI! I just spent $300 on a keyboard for work because I hate the feel of the keyboards at the office, and I just know that Cherry MX Blue switches just wouldn’t fly due to their noise! And touch screen typing is bad enough (thumb typing on my phone already aggravates my RSI, so much so that I switched to using a Bluetooth keyboard to finish this message), and you get some feedback from touch screens. Amusingly, touch screens have no key travel distance, and VR keyboards have infinite key travel distance! Ah well, I’ll be sticking to a mechanical keyboard and a trackball, this thing isn’t really focused on software developers (other than ones that need to write apps for it).