Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Gemini App for iOS Gets Live View Feature for Real-Time Visual Help

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
67,909
38,614


Google is bringing a new live view feature to its Gemini apps on iOS and Android, allowing users to live stream their surroundings to Gemini to get feedback on what they're seeing. Integration is rolling out starting today.

gemini-live.jpg

In a demo, Gemini identified objects that the user was looking at, corrected wrong assumptions about what an object was, and provided context by answering questions. Gemini's live view can identify objects in real-time, provide assistance with DIY or home improvement projects, help organize spaces, assist with shopping, and more.

You can also share your iPhone or iPad screen with Gemini to get feedback on something that you see online.

Gemini's Live option could be helpful for those who are blind or who have low vision, as it can provide a live vocal feed of a person's surroundings. Live is built on Project Astra, which Google previewed at I/O last year, and it previously rolled out to Pixel devices.

This summer, Google also plans to add personal context to Gemini for features like Gmail's smart reply. Gemini will be able to use relevant information across Google apps to provide a more personalized experience. For example, the AI reply feature in Gmail can sound like you, rather than having a generic voice. It is able to scan past emails to match tone, style, and word choice, plus it can look up notes, documents from Google Drive, and more to add context to emails.

Article Link: Gemini App for iOS Gets Live View Feature for Real-Time Visual Help
 
Article Link
https://www.macrumors.com/2025/05/20/google-gemini-live-ios-app/
  • Wow
  • Haha
Reactions: UpsideDownEclair and decypher44
  • Like
Reactions: Whispy_Snippet, soundweave, Jarman74 and 1 other person
mthomas184 said:
Not gonna lie, even though im deep in the apple ecosystem, i seriously considered switching to a Pixel at this point. Apple has fallen so far behind in terms of literally everything phone related.
Click to expand...
I’m in the same camp as you and I feel like you can still work with the ecosystem of Apple and Google, pixel you can still use apple
Music, with Apple TV you can still view your purchases and watch your videos
 
Watched the I/O demo and it was pretty funny listening to the human call a garbage truck a convertible over and over again and the exhausted-sounding AI trying to correct her.

But it was the Project Astra stuff that was really cool. That is going to be what More Personal Siri promised. Give me an actual assistant on my phone!
 
  • Like
Reactions: soundweave, Jarman74, decypher44 and 1 other person
Are you sure you want the contents of your home cataloged by Google? Can you imagine the advertising opportunies and in this case you have willingly openned your door to the salesman. Now that Musk has integraed government databases, why not capture your home environment to further intrude into what was a private space.

I hope Apple maintains its commitment to privacy, even if some talk about "playing catch up."
 
  • Like
  • Disagree
Reactions: pencapchew, kamyk35 and DogHouseDub
This is not just about all the things Google announced today, but all the things that all the tech companies have announced recently. And it's not just AI, but almost everything. There has been a pattern of lack of innovation and bad decisions and priorities with Apple.

At this point, tech companies no longer need to think about Apple as their competition anymore in terms of innovation. There are plenty of competitors, but Apple is not even on the list in the most relevant categories. That could change in the future, but for now, Apple is out of the game.

Looks like this could be the Nokia/Motorola moment. Apple has the resources to turn it around, but they've been behind for years now, and there is no clear signs of improvement, just additional confirmations of failure and desperation. Very sad. Very disappointed in Apple.

I really don't want to change my devices and ecosystem in the future because it's such a hassle, so I still want Apple to get back in the game, but I haven't seen clear signs of this yet. Hopefully soon I will.
 
Last edited:
  • Like
Reactions: kamyk35, dominiongamma, Jarman74 and 2 others
Should be very useful. Eagerly waiting to try this out. Will be great if there is a Gemini integration with Apple's software this year.
 
  • Like
Reactions: mganu
blaureiter said:
Are you sure you want the contents of your home cataloged by Google? Can you imagine the advertising opportunies and in this case you have willingly openned your door to the salesman. Now that Musk has integraed government databases, why not capture your home environment to further intrude into what was a private space.

I hope Apple maintains its commitment to privacy, even if some talk about "playing catch up."
Click to expand...
You can only catch up for so long before people start to lose faith in the company, Apple was ahead 2008 with the smartphone market, now they have become the joke with Siri and Apple thinking they know better then the users when in fact they are out of touch. Apple Intelligence was hot garbage
 
  • Like
Reactions: kamyk35 and dialogos
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back