Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Not sure how that applies to this scenario. I'm specifically talking about installing 3rd party local network LLMs. This wouldn't take away that ability, but give another alternative that would not require an additional install and setup.
Right, but “an alternative that would not require an additional install and setup” is just enough for the EU to have a problem with. I wouldn’t be surprised if they fined Apple for offering it OR require that Apple make it require an additional install and setup to avoid being fined.
 
  • Like
Reactions: cotyledon


Apple has full access to Gemini to customize the model for Siri and other AI features, reports The Information. Google gave Apple "complete access" to the Gemini model in its own data centers, and Apple can use the access for distillation, or creating smaller models for specific tasks. Apple is able to design models that are built to run on Apple devices without the need to connect to the internet.

google-gemini.jpg

The Information explains that Apple can ask the main Gemini model to perform a series of tasks that provide high-quality results, with a rundown of the reasoning process. Apple can feed the answers and reasoning information that it gets from Gemini to train smaller, cheaper models. With this process, the smaller models are able to learn the internal computations used by Gemini, producing efficient models that have Gemini-like performance but require less computing power.

Apple is also able to edit Gemini as needed to make sure that it responds to queries in a way that Apple wants, but Apple has been running into some issues because Gemini has been tuned for chatbot and coding applications, which doesn't always meet Apple's needs.

Apple is relying on Google's Gemini models for the smarter, chatbot version of Siri that's planned for iOS 27, but the Apple Foundation Models team is still working on Apple AI models that are distinct from the Gemini models.

Siri will be able to do many of the same things that Gemini and other chatbots are able to do, such as answering questions, summarizing information, scanning and understanding uploaded documents, telling stories, providing emotional support, and completing tasks like booking travel.

Article Link: Apple Can Create Smaller On-Device AI Models From Google's Gemini

Apple's privacy stance is difficult to square with Google's practices. I would prefer Apple stick to that.
 
The mainstream models were created by ingesting the world's data. It didn't make sense for Apple to go and do that themselves when it's already been done, especially by Google which has excelled at that.

Apple is all about bringing a technology to the masses in a friendly, efficient way. The long game.

They didn't invent the graphical interface. They perfected it.

They didn't invent the mouse. They perfected it.

They didn't invent the portable computer. They perfected it.

They didn't invent the digital music player. They perfected it.

They didn't invent the smartphone. They perfected it.

... and now we have the AI experience, ready to be perfected.
Apple still hasn't made a good mouse.
 
Very cool. I’ve built a couple of apps, currently just for personal use, that use the on device llm. Surprisingly powerful and fast. Mostly for use on my ipad pro m4. As the memory available increases i expect these models to be more and more useful.
 
  • Like
Reactions: sos47
Interesting to hear this. Looks like everything is moving in the right direction and Apple Intelligence will be much better and will have caught up with the competition by the end of the year.
 
The mainstream models were created by ingesting the world's data. It didn't make sense for Apple to go and do that themselves when it's already been done, especially by Google which has excelled at that.

Apple is all about bringing a technology to the masses in a friendly, efficient way. The long game.

They didn't invent the graphical interface. They perfected it.

They didn't invent the mouse. They perfected it.

They didn't invent the portable computer. They perfected it.

They didn't invent the digital music player. They perfected it.

They didn't invent the smartphone. They perfected it.

... and now we have the AI experience, ready to be perfected.
There's a lot of perfecting that's still needed, though. Case in point: this is what Apple AI in the Apple Photos app had to say about my photo of the Blue Angel's Boeing F/A-18.

Screenshot 2023-08-07 at 2.45.15 PM copy.jpeg
...
 
First of all, what does that have to do with this news? Secondly, your "testing" must have some serious flaws because currently, Gemini is the best LLM on the market. That, of course, can change very soon.
Gemini is great but it's a toss-up with ChatGPT 5.4 in my experience. I use both and typically default to Gemini, but I don't think one of them is clearly better than the other.
 
ewww...
Seeing how Google's view on privacy (looking at the incognito mode incident), I would not trust them one bit.
They would have a back door to the data. 🙁
It's not possible for Google to have a back door with this. It's just a model that stands alone. It's like going to a farmer's market and buying an apple. You can do whatever you want with the apple once you buy it. The farmer who grew it on a tree doesn't have access to anything you do with the apple.
 
I have very LOW expectations for Siri. And it does those simple things well. Set a timer, set an alarm, send a text message to my wife. Those are examples I can say while driving and never take my hands off the steering wheel and can hear audio back over the car speakers.

If one is asking technical questions, then one is expecting technical answers back and that diversion of attention is called distracted driving at the scene of an accident and the driver would be at fault.

Oh, what fun we are having on this emotional roller coaster from one lie to another from most vendors most of the time. I seem to be wearing permenntly brown shoes.......
 
Last edited:
Gemini is the worst AI app I've used to date, in my testing anyway.

Gemini isn't "a singular thing" that can be wholly judged by a point-in-time experience. It continues to evolve organically, but yes, it has some very capable competitors.

This article is not about using Gemini directly, but as a "teacher" of smaller, specialized on-device models.

ewww...
Seeing how Google's view on privacy (looking at the incognito mode incident), I would not trust them one bit.
They would have a back door to the data. 🙁

Apple's privacy stance is difficult to square with Google's practices. I would prefer Apple stick to that.
Do not conflate Gemini chat with the Gemini model. Same for Chat GPT and GPT 5.xx

The chat bits are a layer on top of the model. This is the way that Siri will work. Copilot is similar.

You can use the model 100% obfuscated from the company that created it. This is how Apple will insure user privacy. Nothing gets back to Google.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.