Got a tip for us?
Let us know
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Apple's Siri Chatbot May Run on Google Servers
- Thread starter MacRumors
- Start date
- Sort by reaction score
100% on-device , all the time disappeared with Apple Intelligence when it was announced. There was always a Private Cloud Compute (PCC) aspect to that. Therefore not all of it was going to be on-device.
Where there decision is made to go off-device or not is done all on device. Just because it can 'punt' some stuff off device doesn't mean it will. Apple supposedly needing more compute power than their PCC cluster can provide, means that collectively all the M2+ and A18+ devices out there have even more aggregate compute power. Avoiding using that power is the last thing they'd want to do. ( i.e., they will want to keep the 'overflow' to a minimum. )
Apple basically thought their guys were better and smarter than the entire industry.
The hyperscalers were idiots. All companies behind AI accelerator chips, whether Nvidia, Google, or Huawei were all idiots. Somehow, dinky M4 Ultra servers were supposed to match or outperform dedicated NPUs connected to HBM.
The reality was, Apple's software and hardware guys were significantly behind the industry. You don't witness Apple's AI team members regularly leave if they're on the cutting edge.
Is anyone surprised? Hardware for LLM inference is expensive and consumes huge amounts of energy. More cost effective to contract your compute than buy it to run yourself.
it's like apple giving training to google Gemini and using apple device
no….
NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOooooooooooooooooooooooooo……..
NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO !!!!!!!!!!!!!!!
STOP
THIS
MADNESS
APPLE
PLEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAASE!!!!!!!!!!!!!!!!!
AND
THANK YOU!!!
This makes me even happier to have already turned off Siri and Apple Intelligence and some other stuff SMH
Srs question…appple stuff running to google servers allows goog. To be basically on the inside of Apple? Around all personal user data and iCloud backups etc.?
NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOooooooooooooooooooooooooo……..
NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO !!!!!!!!!!!!!!!
STOP
THIS
MADNESS
APPLE
PLEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAASE!!!!!!!!!!!!!!!!!
AND
THANK YOU!!!
This makes me even happier to have already turned off Siri and Apple Intelligence and some other stuff SMH
Srs question…appple stuff running to google servers allows goog. To be basically on the inside of Apple? Around all personal user data and iCloud backups etc.?
Right. And considering Apple scale, they would likely take over an entire data center. So even if it’s owned by Google, doesn’t mean they will have anything to do with it.
Apple has lost its collective mind if this is true, and this is coming from an Android user.
No, actually this forum's commentary sounds like they have no idea what they are talking about. Apple never had the uniquely, singular mechanism for doing private AI compute. Apple had one option they had built themselves.
Google Cloud Services makes money from renting equipment; not by serving ads. Lots of money.
Google says new cloud-based “Private AI Compute” is just as secure as local processing
New system allows devices to connect directly to secure space in Google's AI servers.
arstechnica.com
To convince some folks to 'rent' they training units and compose non Google AI models they have a way to run their servers with
[ e.g., this is how you might get contracts to run data centers for the USA Government for projects. All the USA, superscaler cloud vendors do this because who wants to block potential Government contract money. Who wants to block potential big mega bank money, who wants to block big Wall St player money , etc. That would be nobody who is serious about maximizing their revenue stream in this business. ]
Apple can probably run PCC cheaper than Google's cloud compute will cost ( if they had planned far enough ahead). They also probably will have to backslide on their. "only 100% renewable electricity" goals. So more money and less 'green' save the planet, but there is little privacy leakage here if properly use the tools available.
You've got to assume that Apple will require Google to manage this environment separately and set to Apple's standards, or they wouldn't engage with a third-party.
I'm not worried about this until it's announced publicly we hear the details of how security will be managed.
I'm not worried about this until it's announced publicly we hear the details of how security will be managed.
Are we talking about the same privacy-caring company that handed the keys to their datacenters to the Chinese govt?
Apple’s Compromises in China: 5 Takeaways (Published 2021)
To stay on the good side of the Chinese authorities, the company has made decisions that contradict its carefully curated image.
- Apple stores customer data on Chinese government servers.
- Apple now shares customer data with the Chinese government.
- Apple proactively removes apps to placate Chinese officials.
- Apple banned apps from a Communist Party critic.
- Tens of thousands of iPhone apps have disappeared in China.
Are we talking about the same privacy-caring company that allows apps that can track users and collect a ton of data on them onto their App Store?
At Apple, profit comes before privacy.
Last edited:
I wasn’t talking about privacy. Their AI “strategy” is a hot mess. Apple Intelligence is garbage. Siri is garbage. Now they’re desperately hoping Google will bail them out. First it was on device, then private cloud compute, now Google servers. They’re obviously just making this up as they go along. They’re being reactive instead of proactive and it shows. They look like they are flailing and have no real strategy.No, actually this forum's commentary sounds like they have no idea what they talking about.
Google Cloud Services makes money from renting equipment; not by serving ads. Lots of money.
Google says new cloud-based “Private AI Compute” is just as secure as local processing
New system allows devices to connect directly to secure space in Google's AI servers.
To convince some folks to 'rent' they training units and compose non Google AI models they have a way to run their servers with
[ e.g., this is how you might get contracts to run data centers for the USA Government for projects. All the USA, superscaler cloud vendors do this because who wants to block potential Government contract money. Who wants to block potential big mega bank money, who wants to block big Wall St player money , etc. That would be nobody who is serious about maximizing their revenue stream in this business. ]
Apple can probably run PCC cheaper than Google's cloud compute will cost ( if they had planned far enough ahead). They also probably will have to backslide on their. "only 100% renewable electricity" goals. So more money and less 'green' save the planet, but there is little privacy leakage here if properly use the tools available.
Never let facts get in the way of being a fanboy/girl.Are we talking about the same privacy-caring company that handed the keys to their datacenters to the Chinese govt?
Apple’s Compromises in China: 5 Takeaways (Published 2021)
To stay on the good side of the Chinese authorities, the company has made decisions that contradict its carefully curated image.www.nytimes.com
- Apple stores customer data on Chinese government servers.
- Apple now shares customer data with the Chinese government.
- Apple proactively removes apps to placate Chinese officials.
- Apple banned apps from a Communist Party critic.
- Tens of thousands of iPhone apps have disappeared in China.
It's amazing to me that there are no comments about the last line in the story.
Apple is considering a significant shift in how it operates Siri by potentially running its next-generation chatbot on Google's cloud infrastructure rather than entirely on its own Private Cloud Compute servers, according to Bloomberg's Mark Gurman.
The possibility of running Siri requests on Google servers does not necessarily mean Google would gain access to user data in a conventional sense. Apple already relies on third-party cloud providers, including Google, for parts of iCloud's infrastructure, while retaining control over encryption keys and data handling policies.
Article Link: Apple's Siri Chatbot May Run on Google Servers
Does anyone complaining about this actually routinely use any of the cloud providers?
I couldn't care less whether Apple decided to host Siri on their own servers, or Azure, or Google Cloud, or Amazon, or IBM Cloud, or anywhere else on this side of the Great Firewall.
You're just paying to rent servers instead of owning them. You get the advantage of being able to scale up and down much more quickly because the hardware already exists and is set up... and if you've way overestimated demand, you can just scale right back down and it's not your problem, it's the cloud provider who now needs to go find someone else to rent their servers.
I couldn't care less whether Apple decided to host Siri on their own servers, or Azure, or Google Cloud, or Amazon, or IBM Cloud, or anywhere else on this side of the Great Firewall.
You're just paying to rent servers instead of owning them. You get the advantage of being able to scale up and down much more quickly because the hardware already exists and is set up... and if you've way overestimated demand, you can just scale right back down and it's not your problem, it's the cloud provider who now needs to go find someone else to rent their servers.
“The arrangement would mark a major departure from Apple's emphasis on processing user requests either directly on-device or through its own tightly controlled Private Cloud Compute infrastructure.”
Having tried the current AI (on-device) model, I applaud Apple’s decision to offload it to the cloud. Google, however… I am not so keen, as Apple had already been through Google Maps fiasco in the past. I understand they might keep it on their “private” clusters and stuff, but it can still create a strong dependency.
Having tried the current AI (on-device) model, I applaud Apple’s decision to offload it to the cloud. Google, however… I am not so keen, as Apple had already been through Google Maps fiasco in the past. I understand they might keep it on their “private” clusters and stuff, but it can still create a strong dependency.
No real uproar though, I bet. The average Joe blow only knows goog. Searching and doesn’t even know you can change safari search engine let alone WHY you should do that…the only uproar is here on these one or two measly Mac rumors comment pages smh
This is where the uproar lives and where the uproar dies, too many yachts and islands to own and too little time to do it…
So publicly Apple said none of this stuff would be on their servers? Like wasn’t there an official announcement for this partnership not long ago? Was this when they officially said all of it on Apple cloud compute??
Yeah looking back if they ditched air power and Apple car and just buckled down and then some on AI they might not appear so weak here…
But IMO it’s only AI, there are plenty of other options if Apple Intelligence and Siri is not enough for you…but I’m sure big $$$ is at stake here and if Apple doesn’t do big stuff here with AI their shareholders and stake holders and investors etc aren’t happy then no one’s happy, it seems…so now apples just doing whatever it can to make AI $$$ for shareholders etc…
is Apple genuinely this desperate? i can't imagine this being Apple's decision- rather a stipulation by Google. this whole Apple Intelligence launch has been embarrassing for them.
Before people pick up too many pitchforks, don't ignore this part of the article: "The possibility of running Siri requests on Google servers does not necessarily mean Google would gain access to user data in a conventional sense. Apple already relies on third-party cloud providers, including Google, for parts of iCloud's infrastructure, while retaining control over encryption keys and data handling policies."
It's too soon to know what this arrangement will look like.
It's too soon to know what this arrangement will look like.
I will quote Dr. Seuss on this one: “And we did not like it. Not one little bit.”