Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
The AI Agent feature I've been commenting about:



A scenario:

User
:
Siri, I'd like to have dinner with my girlfriend tonight at that place I walked by last week with the red umbrella. I took a photo of it.

Siri:
Code:
Looks at your Photos (offline), finds the red umbrella, geotagged,
locates the restaurant in Apple Maps (online),
brings up OpenTable (online) cues up a reservation after looking at your Calendar (offline).

That was Sandro's on College St. I've found you a reservation for 2 at 8pm. You get off work at 5, that should give you enough time to get home, get ready and head over to Sandro's. Ana's schedule also shows her free. Would you like me to book it?

User:
Yes... no, wait, can we do 8:30 instead? I'd like to get a bottle of wine, does Sandro's have a corking fee?

Siri:
Code:
Looks up OpenTable (online) to see if there's an 8:30pm reservation.
Looks up Sandro's website (online) and searches for a corking fee.
Looks up Apple Maps for nearby wine stores,
finds one that's on the Ritual app (online) so they can can bag your wine for pickup,
finds that you've ordered 2 different wines via Ritual.

Sandro's has a $6 corking fee. I found you an 8:30 reservation. Would you like Mateus Rose or Wolf Blass - Yellow Label Sauvignon? I can reserve it at the Wine Cellar, a short walk from Sandro's.

User:
Let's do Mateus. Go ahead and book the reservation please.

Siri:
Code:
Goes to OpenTable, places the reservation on your behalf.
Goes to Ritual, orders a bottle of Mateus Rose for pickup at 8pm.
Adds an event in your calendar with directions to the Wine Cellar
and another at 8:30pm with directions from there to Sandro's.
Creates a calendar invite for your girlfriend.

All set! Your Mateus Rose will be ready for pickup at 8pm, Sandro's at 8:30 on College St. and I've sent an invite to Ana.



Apple's advantage in AI is the App Store, far larger than any other platform. If Siri can operate those apps for you (and their published papers show us that's where they're headed) then it'll be far more capable than anything openAI has done.
Hopefully. Alternatively Siri will just be like: “Here are some nice pictures of red umbrellas I found on the web.”
 
It hasn't done anything. Sam Altman and his ilk are some of the biggest con men in the history of the planet. They've created a very flashy box built off of stolen data, and everyone's really amazed at the smoke and light show because they want to be seen as important and trendy and on with "the next thing", and none of them want to admit the emperor not only has no clothes, but that he's coated head to toe in his own excrement.
You don’t like it. We get it. But that doesn’t mean it’s trash and useless. Thousands of programmers use it every day to develop software. It excels at programming.
 
When Siri came out in 2011, I expected a computer like HAL 9000 from Stanley Kubrick's film 2001: A Space Odyssey. I was very disappointed.So I have never used Siri; to me, it is an unfinished piece of software.

With AI, I hope my old expectation will come true of a personal digital assistant that knows my habits, needs, interests etc. An assistant that, like a secretary, but more, , can help you and make your day easier. Later, I hope to see that assistance built into a dedicated Apple house robot that can help with household chores, dusting, cooking, and assisting elderly and sick people with their needs in general. That is my wish and my dream.
 
  • Like
Reactions: Tagbert and rosuna
Maybe they should have started a Siri overhaul years ago instead of working on things like MeMoji.
Exactly. When it comes to macOS, Craig Federighi's delivery record over the last few years is the Safari 15 debacle and u-Turn, Settings UI disaster, Stage Manager, UI iOSification, emojis, memojis, wallpapers and bugs. Oh so many bugs. It's incredible he still has a job at Apple.
 


Apple is planning a major AI overhaul for Siri in iOS 18, and Bloomberg's Mark Gurman says that the update will let Siri control all individual features in apps for the first time, expanding the range of functions the personal assistant can perform.

iOS-18-Siri-Integrated-Feature.jpg

Siri will be able to do things like open specific documents, move a note from one folder to another, delete an email, summarize an article, email a web link, and open a particular news site in Apple News. Apple plans to use AI to analyze what people are doing on their devices, automatically enabling Siri features.

To make this happen, Apple engineers had to rearchitect Siri's underlying software with large language models or LLMs, which is also the technology that's been used for chatbots like ChatGPT. Apple has been working on a deal with OpenAI to integrate OpenAI's ChatGPT technology into iOS 18, and it is also in talks with Google about incorporating Gemini, but Siri functionality likely relies on Apple's own LLM work.

At launch, the new Siri functionality will be limited to Apple apps, and Siri will only be able to respond to one command at a time. Eventually, Apple wants Siri to be able to respond to multiple commands, such as capturing a photo and then sending it to someone in a message.

While the Siri features will be introduced at WWDC 2024, Apple reportedly does not plan to launch them in September when iOS 18 sees an initial release. Instead, Siri will be overhauled in a future iOS 18 update that's set to be introduced in 2025.

Basic AI tasks in iOS 18 will be processed on device, but more advanced capabilities will rely on Apple's cloud servers. Gurman previously said that Apple would power all of the initial iOS 18 features on-device without relying on cloud technology in order to preserve privacy, but rumors have shifted in recent weeks. Part of Apple's new Siri technology will include code for determining whether a request can be processed on device or requires Apple's servers. On-device iOS 18 AI capabilities will largely require an iPhone 15 Pro or later to work, and an M1 or later for iPadOS 18 and macOS 15.

According to The Information, Apple's AI servers will be powered by M2 Ultra and M4 chips, with Apple planning to use the Secure Enclave to "to help isolate the data being processed on its servers so that it can't be seen by the wider system or Apple." Gurman says that Apple will also provide customers with an "intelligent report" that explains how information is kept safe.

We'll hear all about the AI functionality coming to Siri in just over 10 days. WWDC 2024 is set to begin on Monday, June 10.

Article Link: More Advanced AI Siri Functionality Not Coming to iOS 18 Until 2025
In my language, Swedish, Siri has in fact become worse for every hear of updates. Simple things like calling someome or asking about the the weather fails with either nothing back, Im working on it or that it cant fint the contact.
I dare to say no one is using it since it fails about 30% of the time.
 
Bro ROFLMAO .. not at your or anyone using ios still, trust me I feel your angst!

You SHOULD care when!
- front page news on this site highlights changing icon colours; FREAKING ICON COLOURS! that's the highlight of wwdc 2024 that's accessible to customers day one or 1 week after??!!

If you see Craig pulling ANY cutsey winks or jokes you guys seriously need to smash em with tomatoes in the press cause this seriously is the final draw/straw for crap - and all these years no REAL work has been done to improve Siri - and if you come up with anything to counter this really people need to think WHAT of ANY OF IT does an executive deserve their exorbitant pay raise or any stick options of any kind for 5yrs before delivering anything NOT purchased or simple voice refininment.

If and IF Siri's become a SERIOUSLY important and powerful AI not simply in it's own right but the entire Industry like Knowledge Navigator promised, or like what Siri wowed us all upon initial introduction... then anything Ai related 1st step should be to kick out their lead on this that was hired from
Changing the icon colors is a MASSIVE improvement and something we have all wanted for more than a decade. It’s a HUGE achievement that Apple finally cracked the nut on how to do that. It’s truly amazing tech.

Btw. Don’t expect that this feature will be full functional until 18.3.7.

It will not be available in 18. In 18.1 you can set icons to be transparent.


/S
 
The AI Agent feature I've been commenting about:



A scenario:

User
:
Siri, I'd like to have dinner with my girlfriend tonight at that place I walked by last week with the red umbrella. I took a photo of it.

Siri:
Code:
Looks at your Photos (offline), finds the red umbrella, geotagged,
locates the restaurant in Apple Maps (online),
brings up OpenTable (online) cues up a reservation after looking at your Calendar (offline).

That was Sandro's on College St. I've found you a reservation for 2 at 8pm. You get off work at 5, that should give you enough time to get home, get ready and head over to Sandro's. Ana's schedule also shows her free. Would you like me to book it?

User:
Yes... no, wait, can we do 8:30 instead? I'd like to get a bottle of wine, does Sandro's have a corking fee?

Siri:
Code:
Looks up OpenTable (online) to see if there's an 8:30pm reservation.
Looks up Sandro's website (online) and searches for a corking fee.
Looks up Apple Maps for nearby wine stores,
finds one that's on the Ritual app (online) so they can can bag your wine for pickup,
finds that you've ordered 2 different wines via Ritual.

Sandro's has a $6 corking fee. I found you an 8:30 reservation. Would you like Mateus Rose or Wolf Blass - Yellow Label Sauvignon? I can reserve it at the Wine Cellar, a short walk from Sandro's.

User:
Let's do Mateus. Go ahead and book the reservation please.

Siri:
Code:
Goes to OpenTable, places the reservation on your behalf.
Goes to Ritual, orders a bottle of Mateus Rose for pickup at 8pm.
Adds an event in your calendar with directions to the Wine Cellar
and another at 8:30pm with directions from there to Sandro's.
Creates a calendar invite for your girlfriend.

All set! Your Mateus Rose will be ready for pickup at 8pm, Sandro's at 8:30 on College St. and I've sent an invite to Ana.



Apple's advantage in AI is the App Store, far larger than any other platform. If Siri can operate those apps for you (and their published papers show us that's where they're headed) then it'll be far more capable than anything openAI has done.
Dream on, Apple is not even on the playfield.
 
Not going to happen.

OpenAI will not deliver the supposed gains that they are selling. Microsoft will have realised their CoPilot pyramid scheme isn't playing out and is actually a net financial loss that has detracted from other product value and existing customers and the board will throw Satya out and switch focus in a mass panic to security to retain government revenue in the cloud. Also NVidia's hyped valuation will crash when the market reaches saturation. About this time everyone will discover they don't actually need this current fad of "AI" and all it does is hallucinate stuff within a limited window of credibility. Also government regulation will catch up and kick the market in the balls.

(these are actual market positions that people are playing at the moment)

Edit: Apple are playing the usual conservative engineering policy game that they do which is adopting mature outcomes from the hype, you know the ones that don't make you drive off a cliff or replace the moon with a donut on thursdays on your camera.
No, AI will enslave us!!! It's a matter of years or months, I tell you!!
I 've seen it in many documentaries, including Terminator 2.
 
Agreed, I don’t think Apple will implement their own LLM until they have one that doesn’t hallucinate and create a potential PR disaster for them. I think that’s why they’d prefer to partner with openai, so they have a scapegoat when it gives inaccurate info

Everything Apple does is analyzed under a microscope, they don’t get the benefit of the doubt when they eff up like other companies, they get torn to shreds for the tiniest things, even if it affects 0.1% of users. They’d rather be “behind” than release something that’s a liability
14 years ago, when Apple turned up late to the party, they blew away the competition. But Apple's record in software esp. AI/machine learning is that they're not just late, they're still learning the A, B, C.
 
In my language, Swedish, Siri has in fact become worse for every hear of updates. Simple things like calling someome or asking about the the weather fails with either nothing back, Im working on it or that it cant fint the contact.
I dare to say no one is using it since it fails about 30% of the time.
If it's any consolation, my friend, it's not just a problem in non-English languages. Siri is embarrassingly bad in every language.
 
14 years ago, when Apple turned up late to the party, they blew away the competition. But Apple's record in software esp. AI/machine learning is that they're not just late, they're still learning the A, B, C.
What party was that? What did they blow away?
 
Still, Apple and Google are the two companies that can fusion the learning/generative power of LLM with a wide ecosystem of hardware, applications and services. ChatGPT is marvelous in many ways but limited by being in a walled garden. Giving a kind of personal assistant access to apps and information and the depth of what (for better or worse) your devices know about your life, would be outstanding in so many scenarios, and this cross-pollination is basically something only Apple can deliver, from your watch to your desktop. And it fits the brand’s credo of making computers more and more personal. Plus, the brand has more power and pull to implement ideas … just as an example, finding a popular high-end voice actress for Siri should be dramatically simpler for the owners of AppleTV+ than for OpenAI.
 
  • Like
Reactions: Tagbert and rosuna
On-device iOS 18 AI capabilities will largely require an iPhone 15 Pro or later to work
Lol. It'd look extremely bad to ship out features that aren't even supported on the latest version of the phone you paid 1000 euro for that they currently have out. I don't think they will do this. If Samsung and Google can do it on older devices with their "slower" processors it sends out a really bad message about Apple's silicon, their decision to put the previous year's processor in today's phone because they believe it's powerful enough, etc. PR nightmare and makes them look confused on what they're doing (which I bet they are internally).
 
Last edited:
At first i was glad that Apple implements an own - maybe more innovative - AI with Siri (Pro?) and doesn't buy an AI service like ChatGPT.
Now they aren't able to release anything until 2025? Did they sleep under a rock, was there nothing in development?
I don't want to use normal Siri anymore, it's painful (in comparison).

F*k it, i enable ChatGPT with Shortcuts and when i say "Hey Siri Pro" then ChatGPT pops up instead of Siri.
 
Google Gemini is great for sure, the way it recommends people use glue to adhere cheese to a pizza, or that depressed people should just off themselves. Personally I've found the advice to eat pebbles very helpful.

And I'm sure CoPilot will work just as well as every other Microsoft product these days...which is to say it'll have 30 pop-ups per week, change settings on you as it wants, and will generally be a poor experience overall.

"AI" is a meaningless buzzword being used by failing companies to juice their stock price. Apple has had machine learning driven features in iOS for half a decade now. But because some total losers like Pichai and Nadella used the right buzzwords they're industry leaders now, I guess.
Someone who's never used a Pixel or Samsung with AI.

Some silly answers posted on social media and you think gemini is trash, maybe do your research from outside of twitter.

You think Apple has had ML for half a decade, they say that but what do they have to show for it? nothing.

Forget chat bots and marketing, I'm talking about real use for AI for the average user.

The iPhone is a toy compared to what Gemini is doing for galaxy and pixel, email summaries, image and video editing, REAL assistant capabilities, smart replies, PDF summaries, notification cool down, circle to search etc etc I could go on.

And what do we have? Siri, "look up" that NEVER works and Animoji 🤣
 
Weak and pathetic, but not surprising. But here comes the people who gaslight themselves and say "I'd rather Apple be late and do it right." Not when they are VERY VERY late, and still don't do it right.

Millions of people are already enjoying AI features by other companies. They are imperfect but usable, and ever improving. Meanwhile, Apple has nothing, and seemingly plans to have almost nothing.

curious if you think we're at the beginning, the middle, or the end of the AI race and whether that factors in at all?
 
  • Like
Reactions: Tagbert
What they should do is have the UI elements of any arbitrary app be recognized by AI and controllable by commands given to AI. That way you could operate anything and everything by spoken commands, and also could script UI workflows involving arbitrary apps.
Yeah kinda like what the rabbit ai is trying to do with their large action model
 
  • Like
Reactions: Tagbert
I think most people are discounting that what Apple seems to be building is a Large Action Model, not just a Large Language Model.

If Apple plays its cards right, it has a very real chance to be the leader in the LAM space thanks to its control of the entire tech stack.
 
With half of the announced features missing in .0 releases in recent years, Apple should just remove the major version number and make iOS a rolling release.

and miss out on the marketing buzz of announcing everything at a single event? Highly unlikely.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.