Visual Intelligence is very poorly integrated compared to Samsung's method

[DMG35]

I really dislike how Apple is using visual intelligence on the iPhone unless I am missing something here. On the S25 Ultra I can hold touch and hold on the bottom of the phone and I can literally use it anywhere in any app and then circle anything I am looking for and it will find it. I can be on a web page, hold the bottom, then circle what I want it to find and boom it finds it. Apple's integration of this is just the camera and its not nearly as useful as it should be. Is there a way to make it work outside of taking a picture of something? Why is it only through the camera? Apple really needs to fix this and take a cue from how Samsung has this integrated because its 1000 times more useful.

Or, am I missing something and not using it correctly on the iPhone?

 

[Ctrlos]

I really dislike how Apple is using visual intelligence on the iPhone unless I am missing something here. On the S25 Ultra I can hold touch and hold on the bottom of the phone and I can literally use it anywhere in any app and then circle anything I am looking for and it will find it. I can be on a web page, hold the bottom, then circle what I want it to find and boom it finds it. Apple's integration of this is just the camera and its not nearly as useful as it should be. Is there a way to make it work outside of taking a picture of something? Why is it only through the camera? Apple really needs to fix this and take a cue from how Samsung has this integrated because its 1000 times more useful.

Or, am I missing something and not using it correctly on the iPhone?

No, you sadly cannot use it on a screenshot although I'd be amazed if this didn't make it into iOS19.

Visual Intelligence is based on whatever your phone camera can see. In this respect its actually one of the better implementations of AI I've seen on any device, able to identify plants, search the web or ask ChatGPT about just about anything. If you take a picture of an event flyer or poster it will automatically create a calendar entry for you which I find really useful. I've done everything with mine from asking whether unknown foragings are edible to calculating Young's Modulus of material samples.

 

[Paddle1]

You're not missing anything. There's a reason why Apple Intelligence gets so much negative feedback. It does work well when it does, but that's because it's using Google and ChatGPT AI. It's lacking on Apple's end, as per usual for their AI.