Gemini for Mac Adds System-Wide Voice Dictation and Screen-Aware Commands

[MacRumors]

Google today updated Gemini for Mac to add a new quick keyboard shortcut that activates voice mode. By long-pressing the Fn key, users can speak naturally to Gemini from any window on their desktop machine.

Gemini supports intelligent dictation, so users can speak to the chatbot using natural language and Gemini will transcribe their words to text. Ums, ahs, and other filler words are removed during the process, and it can catch mid-sentence corrections, dropping formatted text at the cursor.

There's an opt-in screen-aware reasoning mode. If enabled, Gemini can see what's on the Mac's screen to complete tasks. Users can highlight files, images, text, or documents and have Gemini edit, summarize, and compose content in the app they're working in. Gemini is also able to generate and edit images when the screen-aware mode is turned on.

A double press on the Fn key is one of the options for triggering the Mac's built-in dictation feature, so the Gemini replacement will be familiar to those who prefer Gemini.

Gemini's new Mac voice mode is rolling out globally to all Gemini for Mac users in English, with Google planning to add more languages in the future.

Article Link: Gemini for Mac Adds System-Wide Voice Dictation and Screen-Aware Commands

 

[LeeW]

Still better than Siri.

 

[AusMness]

Literally why would anyone use this now that we have Siri AI

 

[acader]

Wasn't Mac's built-in dictation feature supposed to have done this in version xx-1?

 

[acader]

Literally why would anyone use this now that we have Siri AI

Because Gemini can pronounce Siri better than Siri can pronounce Siri.

 

[jarman92]

I’d love to install Gemini but, alas, it kinda sucks and installs a bunch of unremovable background and launch agents.

Literally why would anyone use this now that we have Siri AI

Siri is decent but, in my experience, is significantly slower than Gemini and very terse, often to a fault.

Also Siri’s incessant “I may make mistakes” and “I’m not an expert” disclaimers get really annoying.

 

[Natas1000]

Delete

 

[Scotty_Trees]

what's with all the strong push for AI stuff around this site lately?

 

[ifxf]

Literally why would anyone use this now that we have Siri AI

Access to larger models.

 

[iShater]

So the bottom of the barrel of AI just made it to MacOS. Nice. How's Siri AI doing? 😛

 

[MacMan988]

Came here to read those "no thanks" comments 🙂

 

[Octavius8]

need to see it in action to find out if can really help me to sort my files or if it pite gimmicky

 

[scrod]

So I get to stream the contents of my screen to Google so they can data-mine it and violate my privacy even harder?

 

[Elwe]

Also Siri’s incessant “I may make mistakes” and “I’m not an expert” disclaimers get really annoying.

Given that both professionals and students are making career-ending mistakes by relying upon information that is incorrect, I’d say these reminders are still a good idea for many. I sit on two professional board-level examination panels, and we have had a serious uptake on failure rates. When we press the failed candidates on certain facts which they appear strongly confident about but are incorrect, several have ultimately admitted to using LLMs to distill or acquire information.

 

[LeeW]

Given that both professionals and students are making career-ending mistakes by relying upon information that is incorrect, I’d say these reminders are still a good idea for many. I sit on two professional board-level examination panels, and we have had a serious uptake on failure rates. When we press the failed candidates on certain facts which they appear strongly confident about but are incorrect, several have ultimately admitted to using LLMs to distill or acquire information.

They need a warning about common sense? Seems like AI is not the issue there.

 

[svish]

Glad to see these changes. Will try it out now.

 

[xalea]

what's with all the strong push for AI stuff around this site lately?

Uh, maybe because it's the biggest thing for technology and society since The Internet ..?

 

[kw169]

I downloaded to try it but does not work on my MacBook Air 15 inch
Do you have to have a subscription for this feature?

 

[AppleMad98004]

I downloaded to try it but does not work on my MacBook Air 15 inch
Do you have to have a subscription for this feature?

Yes I believe so. I have it but my colleague who is on the free tier doesn't not.

 

[jarman92]

Given that both professionals and students are making career-ending mistakes by relying upon information that is incorrect, I’d say these reminders are still a good idea for many. I sit on two professional board-level examination panels, and we have had a serious uptake on failure rates. When we press the failed candidates on certain facts which they appear strongly confident about but are incorrect, several have ultimately admitted to using LLMs to distill or acquire information.

I’m sure that’s all true, but you can’t possibly think that disclaimer will have any effect at all? It’s entirely ineffective for those who need it and quite annoying for those who don’t.