Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Apple Preparing to Add ChatGPT Integration to Siri

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
67,482
37,739


Apple is working behind the scenes to get ready to add new Apple Intelligence features to iOS 18, iPadOS 18, and macOS 15. We'll get the first set in the iOS 18.1, iPadOS 18.1, and macOS 15.1 updates, but Apple is preparing for the next batch, too.

chatgpt-siri.jpg

In backend code, MacRumors has discovered new references to Siri's ChatGPT integration as Apple prepares to implement ChatGPT support. Siri code mentions options for ChatGPT-generated text and ChatGPT-generated images, two features that Apple plans to implement soon.

ChatGPT integration with Siri was announced as part of the Apple Intelligence feature set highlighted at the Worldwide Developers Conference, and it is functionality that Apple plans to introduce before the end of the year. ChatGPT integration is not in the current software that Apple is testing, but we are expecting it to come in iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2.

Mentions of Siri with ChatGPT integration first surfaced earlier in October, and we've also seen references to Visual Intelligence, another AI feature that Apple is working on. The separate mentions of images and text are new today, and it's clear that Apple is continuing behind-the-scenes work to get these features ready for launch.

With ChatGPT integration, when users ask Siri a complicated question that the personal assistant is unable to handle, Siri will suggest handing the query off to ChatGPT. ChatGPT will provide relevant information, which will be relayed through Siri.

ChatGPT will be able to generate both text and images, and while Apple Intelligence includes some of this functionality, ChatGPT is more advanced. Apple's Writing Tools, for example, can offer spelling and grammar assistance or change the tone of something that's already written, while ChatGPT will be able to generate text from scratch with a simple prompt.

Image Playground and Genmoji will allow for the creation of cartoon-like images and custom emoji, but ChatGPT's image generation features will be able to be used for more realistic images. Siri will reference the latest GPT-4o model, and ChatGPT integration will be free with no account creation required. Apple and OpenAI will not store ChatGPT requests made from Apple devices, and IP addresses will be hidden.

As for Visual Intelligence, it is an iPhone 16 feature that uses the Camera Control button. iPhone 16 users will be able to point their camera at objects or locations around them, with the iPhone providing information about what's being viewed when the Camera Control button is pressed and held.

iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1 are expected to see a release on Monday, October 28, and we'll likely get the first betas of iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2 shortly after. If testing follows other .2 updates, the software will be released at some point in December.

Along with ChatGPT integration and Visual Intelligence, iOS 18.2 could bring support for the Image Playground image generation feature, Genmoji, and Image Wand, a Notes app feature for generating images from text or basic drawings.

Article Link: Apple Preparing to Add ChatGPT Integration to Siri
 
Article Link
https://www.macrumors.com/2024/10/17/apple-siri-chatgpt-integration/
  • Haha
Reactions: antiprotest
Generating text from a prompt is actually less advanced than rewriting or changing voice/tone of existing content. I’ll be very disappointed if you have to use the OpenAI integration for that - models like llama3.2 3B and Mistral 7B do a wonderful job of text composition, and apps like MLCChat show that they can be run on Apple Intelligence class devices. Not to mention, in the Private Cloud Compute environment.
 
  • Like
Reactions: wnorris and -DMN-
jimscard said:
Generating text from a prompt is actually less advanced than rewriting or changing voice/tone of existing content. I’ll be very disappointed if you have to use the OpenAI integration for that - models like llama3.2 3B and Mistral 7B do a wonderful job of text composition, and apps like MLCChat show that they can be run on Apple Intelligence class devices. Not to mention, in the Private Cloud Compute environment.
Click to expand...
Your point being?
 
  • Like
Reactions: agsystems, dustin_, DocMultimedia and 1 other person
asdfjkl; said:
I wonder if widespread availability of AI via the Apple ecosystem will begin to let the air out the AI bubble. People will be to use it and see that it is really just a parlor trick.
Click to expand...
It’s not a parlor trick - it’s definitely useful for a number of practical purposes. But it’s not Data from Star Trek or whatever science fiction idea people think it is. I just hope Apple is able to drive more focus to on-device implementations, which are private and don’t require the use of giant energy sucking datacenters. Why use a 500B model and the hardware and energy it requires, when a 3B model does what you need?
 
  • Like
  • Love
Reactions: SFjohn, aHappiestGuy, johnsawyercjs and 12 others
Kar98 said:
Your point being?
Click to expand...
Article says that ChatGPT is “more advanced” and uses text generation as an example of how it’s “more advanced“. But that’s not the case. Any model from the smallest on up can compose text from a prompt.
 
  • Like
Reactions: wnorris
jimscard said:
Article says that ChatGPT is “more advanced” and uses text generation as an example of how it’s “more advanced“. But that’s not the case. Any model from the smallest on up can compose text from a prompt.
Click to expand...
Ask Siri something simple. "I'm sorry, I can't do that."
Ask ChatGPT to solve a textual math problem: "Sure! Using this formula and those calculations, this comes to...", and remembers you suck at math and have a cat.

Example: Ask Siri: What's 1958 $58 in 2024? Siri: I found this on the web! And shows a link to some sports ball team?
Ask ChatGPT the same question: $58 in 1958 is approximately equivalent to $614.10 in 2024, considering average inflation rates over that period.

Ask Siri: What do you call the kinds of books published by Paladin Press? *shows link to Scholastic dot com*
ChatGPT: Books published by Paladin Press are often referred to as "how-to" manuals on controversial and often extreme subjects. These include topics such as self-defense, survivalism, weaponry, guerrilla warfare, and other unconventional or underground activities. The term "anarchist literature" or "military and survival manuals" are also commonly used to describe the genre of books that Paladin Press specialized in.
 
Last edited:
  • Like
Reactions: You’re not me, Dark_Omen, agsystems and 2 others
Chuckeee said:
As long as I can opt out and still use my phone with all of capabilities that were available prior to A.I..
Click to expand...
Is that it for you then, you've drawn a line under technology in 2024 and no more further enhancements past this?

I feel my Dad did the same in about 1979 with the calculator, he allowed and learnt that and then he drew a line under it there and decided that was enough.
 
  • Disagree
  • Like
Reactions: SFjohn, flur, oldwatery and 7 others
EightyEight said:
Will there be a simple UI switch to completely turn off Apple AI and give me back all that RAM?
Click to expand...

The RAM that isn't used unless you are actively using the feature? But yes, it can be turned off from a central toggle in Settings.

Pakaku said:
I will keep complaining because it should never be allowed in the first place.
Click to expand...

Should never be allowed...to add features?
 
  • Like
Reactions: SFjohn, johnsawyercjs, FernMam and 8 others
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back