Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster


The biggest change in iOS 27 is Apple's total overhaul of Siri, with Siri turning into Siri AI. Apple delivered on the features originally promised at WWDC 2024 and added new capabilities that turn Siri into a viable competitor to chatbots like Claude and ChatGPT.

ios-27-siri-animation.jpg

Siri AI is available in the iOS 27 beta, but everyone will get access this fall. Below, we walk through everything new you can expect from Siri.

Siri AI

Siri AI is more knowledgeable, more capable, and unlike other chatbots, able to tap into your personal data in apps like Mail, Messages, and Photos. Apple says Siri has understanding and reasoning that wasn't available before, with four main improvements that change how Siri works.

Siri-AI.jpg

All of the different Siri functions come together to allow Siri to do far more than it could before. You can have full back-and-forth conversations with Siri, and include multiple tasks in a single request.

Personal Context Understanding

Apple overhauled its search index, and Siri has access to emails, text messages, files, photos, notes, and more. Siri can find content from across your apps, but it also understands that content. You can ask Siri to surface photos, bring up information from emails or texts, or find files, and the Apple Intelligence semantic index behind the scenes finds what you need.
  • What was that movie my brother told me to watch last week?
  • Can you get me the directions to that place I was supposed to meet Eric tomorrow?
  • What video games did John recommend to me last year?
  • Find images with pancakes from 2024
  • What was the name of that restaurant I ate at in February?
  • What's the confirmation number for my upcoming flight?
  • What do I need to do tomorrow?
  • Show me my photos from the music festival last weekend
  • What's the door code Sarah texted me?
  • Find the lease my landlord emailed me last month
  • Who did I have lunch with two Tuesdays ago?
Broad World Knowledge

Apple can search the web for up-to-date information to answer questions about anything, similar to other chatbots. Siri can analyze documents and get information from the web for additional context, help come up with recipes, do party prep, help with homework, give gardening tips, assist with DIY projects, and much more.
  • When is the Suki Waterhouse show in SF?
  • How can I get tickets?
  • I'm planning a birthday party, can you find me some good cake recipes?
  • What's the difference between pine warblers and goldfinches?
  • What's the Hurricanes score?
  • What are the hours for the closest Ace Hardware?
  • What's a good substitute for buttermilk?
  • What's a 15% tip on $84?
  • Help me plan a 5-day trip to Lisbon
Onscreen Awareness

Siri knows what's on your screen and can answer questions about it. Siri can tell what you're looking at, read text, and analyze images.

Siri can tell you where a photo was taken if there's something recognizable in it, and you can ask questions about any app you're in without having to provide specifics.
  • Where was this photo taken?
  • Summarize this
  • Can you give me directions here?
  • What are the best native plant options for a shady spot near my house?
  • Does this document look correct?
  • What is this?
  • Translate this menu
  • Explain what this chart is showing
App Actions

App Actions allow Siri to use tools in apps to complete requests. Siri can use some apps on your behalf, including apps from Apple and third-party apps that have implemented App Actions support.
  • Write a quick response to this email
  • Send all the photos from today to Eric
  • Add a 3pm Tuesday meeting with the neighbor to my calendar
  • Add these photos to the cat album
  • Get me directions to the post office, but add a stop at the coffee shop first
  • Move my 2pm meeting to Thursday
Siri Design

On the iPhone, a new Search and Ask Siri interface replaces the former Spotlight search option, and it's available from the Dynamic Island. A swipe down from the middle of the iPhone's display brings up Search or Ask, where you can type or speak a question or request to Siri.

siri-ai-dynamic-island.jpg

An animation is displayed as Siri is thinking, and then the Siri bubble expands into a short response. If you swipe down on a response, it brings up a text bar where you can provide clarification or ask another question. A "+" button lets you add images or documents to the conversation.

Some responses use rich information cards pulled from apps. If you ask Siri about the weather, you'll see the current weather forecast. If you ask about upcoming calendar events, you'll see them listed in the Calendar app format.

You can also access Siri by pressing the side button or by using the "Siri" and "Hey Siri" wake phrases.

Systemwide Context

Siri works in any app. You can select text or images, then ask Siri about the selection. If you see an image in Safari you want to know more about, you can long press it to select and then ask Siri whatever you want about it.

Siri App

There is a dedicated Siri app where you can start new conversations or revisit past conversations you've had with Siri.

ios-27-siri-app.jpg

The app has a card-style interface with details on your most recent conversations across all of your devices. You can also use the search button to find conversations, and there's a pin option for conversations that you revisit frequently.

Write with Siri

In iOS 27, you can write with Siri anywhere you type with a systemwide Write with Siri feature. Siri can draft documents from scratch, and in Mail and Messages, it can use the same writing style that you normally use.

Siri can give you feedback on your writing if you select your text and ask Siri how it sounds, and as you type in apps, there's automatic proofreading for misspellings and grammar. Siri can also edit, and you just need to describe the change that you want to make to something you've written, such as changing the tone to be more professional... Click here to read rest of article

Article Link: Siri AI in iOS 27: Features, Requirements, and How It Works
 
Does anyone know if the new Siri or even the search function in Photos, can find photos in the “hidden” section of Photos?

I would assume many would not want that (even though it is supposedly secure), but I actually do want that.

Basically I am looking for a photo of me and a celebrity from 12 years ago, and I can’t seem to pull it up. All of my photos are currently hidden and I have about ten thousand of them. I put them all in the hidden folder so I can take a few out here and there over time as I organize what I want, so everything isn’t cluttering up my main roll.
 
  • Like
Reactions: aberdeenmeadows
1. It's been demonstrated to not be working.
2. It's coming to Europe to bloat your SDD and bottleneck your RAM only Apple won't let you use it.

Trash.

What with the dropping of AW support, Rosetta2 being phased out, and now this...

It's just time to drop Apple. There is strictly no reason to go on in this ecosystem as a European.
 
The article mentions things like "across your apps" and "works in any app"

I use GMail as my email client and Fantastical/Google for my calendar. And other 3rd-party messaging apps.

Do we think the new Siri will be as good in 3rd-party apps as it would in Apple's own 1st-party apps?

🤔
This. I haven't used Apple Mail or Apple Calendar in years due to the need to work cross-platform. My guess is this will not work until the app developers create tools for Siri AI to integrate with them. The app needs to tell Siri AI what tools it exposes so the AI knows how to handle the query.
 
I might leave it on long enough to see if it makes my Safari tabs dance. That sounded funny.

But after that it’s getting switched off.
 
  • Like
Reactions: Huck
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.