Apple Can Create Smaller On-Device AI Models From Google's Gemini

[MacRumors]

Apple has full access to Gemini to customize the model for Siri and other AI features, reports The Information. Google gave Apple "complete access" to the Gemini model in its own data centers, and Apple can use the access for distillation, or creating smaller models for specific tasks. Apple is able to design models that are built to run on Apple devices without the need to connect to the internet.

The Information explains that Apple can ask the main Gemini model to perform a series of tasks that provide high-quality results, with a rundown of the reasoning process. Apple can feed the answers and reasoning information that it gets from Gemini to train smaller, cheaper models. With this process, the smaller models are able to learn the internal computations used by Gemini, producing efficient models that have Gemini-like performance but require less computing power.

Apple is also able to edit Gemini as needed to make sure that it responds to queries in a way that Apple wants, but Apple has been running into some issues because Gemini has been tuned for chatbot and coding applications, which doesn't always meet Apple's needs.

Apple is relying on Google's Gemini models for the smarter, chatbot version of Siri that's planned for iOS 27, but the Apple Foundation Models team is still working on Apple AI models that are distinct from the Gemini models.

Siri will be able to do many of the same things that Gemini and other chatbots are able to do, such as answering questions, summarizing information, scanning and understanding uploaded documents, telling stories, providing emotional support, and completing tasks like booking travel.

Article Link: Apple Can Create Smaller On-Device AI Models From Google's Gemini

 

[Artemiz]

Finally! Apple doing what they do best.

 

[iMac The Knife]

Gemini is the worst AI app I've used to date, in my testing anyway.

 

[coolfactor]

Finally! Apple doing what they do best.

The mainstream models were created by ingesting the world's data. It didn't make sense for Apple to go and do that themselves when it's already been done, especially by Google which has excelled at that.

Apple is all about bringing a technology to the masses in a friendly, efficient way. The long game.

They didn't invent the graphical interface. They perfected it.

They didn't invent the mouse. They perfected it.

They didn't invent the portable computer. They perfected it.

They didn't invent the digital music player. They perfected it.

They didn't invent the smartphone. They perfected it.

... and now we have the AI experience, ready to be perfected.

 

[UltimaKilo]

Gemini is the worst AI I've used to date, in my testing anyway.

First of all, what does that have to do with this news? Secondly, your "testing" must have some serious flaws because currently, Gemini is the best LLM on the market. That, of course, can change very soon.

 

[coolfactor]

Gemini is the worst AI I've used to date, in my testing anyway.

Gemini isn't "a singular thing" that can be wholly judged by a point-in-time experience. It continues to evolve organically, but yes, it has some very capable competitors.

This article is not about using Gemini directly, but as a "teacher" of smaller, specialized on-device models.

 

[coolfactor]

First of all, what does that have to do with this news? Secondly, your "testing" must have some serious flaws because currently, Gemini is the best LLM on the market. That, of course, can change very soon.

It's very good, yes, but the best?

Point us to the evals.

Each major LLM has strengths over the others, and each new version can fluctuate in those strengths.

 

[iMac The Knife]

First of all, what does that have to do with this news? Secondly, your "testing" must have some serious flaws because currently, Gemini is the best LLM on the market. That, of course, can change very soon.

I think it is pretty clear what this has to do with this news. If you think Gemini is the best LLM on the market, I don't think you have very much experience with its competitors.

 

[one more]

Gemini is the worst AI app I've used to date, in my testing anyway.

Which bit - the UI or the quality of its responses?

 

[iMac The Knife]

Which bit - the UI or the quality of its responses?

I don't mind the UI, it is more the quality of the responses.

 

[mlayer]

While it's a bit premature to judge any of the AI players over the quality of their results, it most certainly will be a gating mechanism for Apple. After all they spent a good part of 2025 doing their "bake-off" and ended with Google/Gemini as the winner. There have to be some standards in place before Apple greenlights it for even beta release. If only we had some idea what those standards are.

 

[HazardousT]

This could soon eliminate the need for a separate 3rd party local LLM.

 

[McScooby]

The mainstream models were created by ingesting the world's data. It didn't make sense for Apple to go and do that themselves when it's already been done, especially by Google which has excelled at that.

Apple is all about bringing a technology to the masses in a friendly, efficient way. The long game.

They didn't invent the graphical interface. They perfected it.

They didn't invent the mouse. They perfected it.

They didn't invent the portable computer. They perfected it.

They didn't invent the digital music player. They perfected it.

They didn't invent the smartphone. They perfected it.

... and now we have the AI experience, ready to be perfected.

Claude might want a word.

 

[Ct applefan]

Finally! Apple doing what they do best.

What’s that, delaying just about everything

 

[sw1tcher]

The mainstream models were created by ingesting the world's data. It didn't make sense for Apple to go and do that themselves when it's already been done, especially by Google which has excelled at that.

Apple is all about bringing a technology to the masses in a friendly, efficient way. The long game.

They didn't invent the graphical interface. They perfected it.

They didn't invent the mouse. They perfected it.

They didn't invent the portable computer. They perfected it.

They didn't invent the digital music player. They perfected it.

They didn't invent the smartphone. They perfected it.

... and now we have the AI experience, ready to be perfected.

They didn't invent the virtual assistant (i.e. Siri), they... Crap. Bad example.

Let me try this again....

They didn't invent advertisements in Maps, they'll perfect it.

Apple to Introduce Ads in Apple Maps as Part of Services Revenue Push

Apple is planning to include ads in Apple Maps search results as soon as this summer, reports Bloomberg. Apple is aiming to earn more money from its services division, and it could announce plans for Maps ads as early as this month. Ads in Apple Maps will be similar to ads in Google Maps...

www.macrumors.com

 

[ArrayDecay]

"The Information" is such an incredibly pompous and self-important name.

 

[coolfactor]

Claude might want a word.

Claude is exceptional, too. I do hope that "a new Apple" has the wisdom to be more open, voluntarily, rather than being forced to be.

Is Claude "invisible" in its usage yet? Siri will be. That's Apple's end game. Using technology without knowing you're using technology.

 

[Unregistered 4U]

This could soon eliminate the need for a separate 3rd party local LLM.

Nope. Because if it did the EU would come a-running, hands out because “anticompetitive”.

 

[Unregistered 4U]

"The Information" is such an incredibly pompous and self-important name.

And whenever you see “The Information” you can just ignore what you read. I mean, I suppose it’s as entertaining as any fiction, just don’t expect it to be based in reality… just like fiction. 🙂

 

[coolfactor]

They didn't invent the virtual assistant (i.e. Siri), they... Crap. Bad example.

I hope you're hungry, cuz I know some words that will need eating. 😁

People forget that Siri is deeply integrated. Very different path to upgrade that tech than rolling out an app or website.

 

[HazardousT]

Nope. Because if it did the EU would come a-running, hands out because “anticompetitive”.

Not sure how that applies to this scenario. I'm specifically talking about installing 3rd party local network LLMs. This wouldn't take away that ability, but give another alternative that would not require an additional install and setup.

 

[boast]

Wouldn't this just be gemma3:1b ?

 

[B4U]

ewww...
Seeing how Google's view on privacy (looking at the incognito mode incident), I would not trust them one bit.
They would have a back door to the data. 🙁

 

[StuBeck]

While it's a bit premature to judge any of the AI players over the quality of their results, it most certainly will be a gating mechanism for Apple. After all they spent a good part of 2025 doing their "bake-off" and ended with Google/Gemini as the winner. There have to be some standards in place before Apple greenlights it for even beta release. If only we had some idea what those standards are.

I hope. My concern is that Apple went down a path with their own AI tool in 2023 and 2024, though it was good, realized it wasn't, and then panicked. Anything in this article was already known...Apple was going to use Gemini as their base for the AI they sold us on the iPhone 16 for example and never delivered.

 

[danskin]

Let me guess it's not gonna be available on the iphone 16 series which they advertised apple intelligence on.