Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More

[MacRumors]

The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.

With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.

Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.

Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.

The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.

Article Link: Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More

 

[appleguy123]

Cool af

 

[tripsync]

it can even identify the missing digits in your bank account.

 

[Apple Fan 2008]

This seems like an awesome and interesting feature

 

[McWetty]

Now I can tell my wife that I have to buy the Vision Pro for our trip to Japan next year.

 

[TheYayAreaLiving 🎗️]

Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.

 

[mushy peas]

Excellent features but I have noticed things can be cluttered if you don’t stay on top of it.

View attachment 2221725

Does it have an Expose type feature? I can imagine with windows all around you that one easy way of invoking an Expose that shows all open windows would be handy.

 

[jimbobb24]

So .... can I look at my iPhone, copy text, and paste it into a field on the Vision Pro? That sounds pretty great. How about off a document sitting on the desk in front of me?

 

[vegetassj4]

Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.

View attachment 2221725

Wait until they put in app ads on the thing....

 

[Aston441]

That picture perfectly encapsulates the future.

 

[TracesOfArsenic]

Sounds like an iPhone.

 

[TimHalfCooked]

Wonder if it will notice when I'm not wearing trousers and open the appropriate website?

 

[vegetassj4]

Wonder if it will notice when I'm not wearing trousers and open the appropriate website?

Surely you are referring to somehting like this, right...right!!!??!?!?

 

[now i see it]

Im looking forward to walking around in a foreign country while wearing these

 

[tweaknmod]

I’m excited for the consumer-targeted version of this, when it’s ready.

The potential here is pretty great, if you ask me. 👍

 

[Orange Bat]

Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.

View attachment 2221725

And imagine when the background is your own cluttered living room filled with dirty plates, kid‘s toys, and 20 year old furniture and and not some sanitized Apple house that looks like your the first person who has ever been inside.

 

[timonz]

So the killer app for this is finding my keys? Sign me up.

 

[redbeard331]

And imagine when the background is your own cluttered living room filled with dirty plates, kid‘s toys, and 20 year old furniture and and not some sanitized Apple house that looks like your the first person who has ever been inside.

And that’s when you turn the dial and you are suddenly swimming on the surface of the sun.

 

[StoneJack]

Inner child

 

[tonywalker23]

I read a few pages today in the new Make Something Wonderful book by Jobs, and I got to the section about the 2001 first Apple Store. He is talking about the apple products but then mentions that they also had third party cameras, camcorders, digital organizers, and mp3 players… and naturally my mind thought about how my iPhone does all that (and tons more) in a relatively short time after the Apple Store first opened...

And I wonder, 5-10 years from now?, what will this thing look like, how slim will it get, will it replace the glasses I wear now and be just a few ounces and look like normal glasses? Seems crazy to even think that...

But considering that my first gen iPod I listen to led to my thin and powerful iPhone, and the iMac g4 on my home desk is archaic compared to my 11" super thin iPad Pro → I look fwd to what the future holds for this tech and the innovation that comes along with it.

 

[newyorksole]

Now I can tell my wife that I have to buy the Vision Pro for our trip to Japan next year.

I’m going for the first time in September!

 

[MindYourMind]

Now I can tell my wife that I have to buy the Vision Pro for our trip to Japan next year.

By then, you might even be able to rent it.

 

[genovelle]

Im looking forward to walking around in a foreign country while wearing these

I’m willing to bet the reason they didn’t mention it is because it’s for the more compact models down the road or glasses 🤓

 

[genovelle]

And imagine when the background is your own cluttered living room filled with dirty plates, kid‘s toys, and 20 year old furniture and and not some sanitized Apple house that looks like your the first person who has ever been inside.

That is when you use the VR space of the sanitized Apple House. Lol

 

[genovelle]

vaporware?

Can’t be vaporware, it was never announced.