Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
65,702
34,341



iOS-9-Siri-250x213.jpg
The Verge's Walt Mossberg today wrote a critical article on Apple's Siri personal assistant, exploring the service's shortcomings, mistakes, and inability to answer some simple questions that competing products have no problem with.

Entitled, "Why does Siri seem so dumb?", Mossberg's article, covers several questions Siri couldn't answer, ranging from queries about political candidates to the date of the World Series to the weather in Crete. In each instance, Siri failed to provide the desired information, while Google Now, Google's Siri competitor, was able to answer every single question correctly.
In recent weeks, on multiple Apple devices, Siri has been unable to tell me the names of the major party candidates for president and vice president of the United States. Or when they were debating. Or when the Emmy awards show was due to be on. Or the date of the World Series. When I asked it "What is the weather on Crete?" it gave me the weather for Crete, Illinois, a small village which -- while I'm sure it's great -- isn't what most people mean when they ask for the weather on Crete, the famous Greek island.
According to Mossberg, Apple has fixed many of the above Siri shortcomings thanks to his feedback, and has "stressed" to him that the company is "constantly improving Siri." Apple says it focuses more on tasks like placing phone calls, sending texts, and finding places rather than "long tail" questions, which aren't as popular with iPhone and iPad users. Mossberg speculates that such questions aren't popular anymore because people "just give up" on asking Siri these types of things due to failed responses.

Mossberg also outlines several failures with Siri's cloud-based services, from searching through iMessages to locating photos to finding calendar appointments, drawing the conclusion that Apple has "wasted its lead" with Siri, which is now forced to compete with services from Google, Amazon, and Microsoft. Mossberg believes that Siri "seems stagnant" and is "too limited and unreliable" compared to other services.

Though it may not seem like it, Apple has been putting a lot of effort into improving Siri. Back in August, Apple executives Eddy Cue, Craig Federighi, and Phil Schiller explained that machine learning techniques have cut Siri's error rate by a factor of two, improving understanding. Since 2014, Siri and other on-device features, like the QuickType keyboard, Spotlight, autocorrect, Maps, and more, have been powered by a neural net-based system that is able to provide users with more personalized responses and actions.

Recent rumors suggest Apple aiming to improve Siri's functionality even further in an effort to build the personal assistant into an Echo-like Smart home device that would do things like control smart home accessories. Apple is also said to be working on an "Invisible Hand" initiative that would allow users to fully control their devices through a Siri command, something that could debut within three years.

Mossberg's full article on Siri, which is well worth reading, can be accessed over at The Verge.

Article Link: Walt Mossberg Calls Siri 'Too Limited and Unreliable' to Compete in 'Coming AI Wars'
 

tekchic

macrumors 68020
Apr 19, 2010
2,056
1,763
Phoenix, AZ
Siri sets my alarms every night, and adds items to my Grocery list in Reminder. That's it. Apart from that, things like "Call my dad" completely confuzzles her where she tries to call ME... yet "Call my father" works fine. No logical sense whatsoever.

I've pretty much given up on Siri because 99% of the time, anything out of the ordinary (timers, reminder items) seem to just get me a snarky, useless response which triggers my nerd rage. :D
 

tongxinshe

macrumors 65816
Feb 24, 2008
1,066
655
The worst part of Siri is not that it being dumb, it's that you have no way to point out its dumbness, via continued conversation!

No real person can guarantee to understand everything at first sight, they get them eventually by piecing together the information collected during the whole conversation.

Me: I want to visit Liz' house.
Siri: There is no one named Lucy in your contacts.
Me: Her full name in my contact is Lizzy Romi.
Siri: I am sorry I don't understand what you mean.
 
Last edited:

maxsix

Suspended
Jun 28, 2015
3,100
3,731
Western Hemisphere
I must say I never expected Walt Mossberg, the long time Apple Shill who was chosen and personally groomed by Steve Jobs, to ever question anything Apple. But with Jobs dead and no longer available to look after his charges like Walt, David Pogue, and others it's more of a level playing field, Mossberg feels free to speak out.
 

Traverse

macrumors 604
Mar 11, 2013
7,711
4,490
Here
Siri's good for simple things like "Remind me to..." or "wake me up at..." but that's really just voice commands which tech has been able to do since the early 2000s. When Forstall announced Siri he said "the ability to understand what you mean and act on it...that's the breakthrough" and Siri has never been able to do that to me. It just recognized certain phrases.

I'm shocked at what Siri can't do. I can imagine some common stuff that Siri still can't do like:
  • "What time is XXXX on TV tonight?"
  • "What channel is XXXX on?"
  • "How much is XXXX on Amazon?"
  • "Check for new emails."
  • "When was my last email from X?"
  • "Text XXXX about [subject] in one hour."
  • "What's the best way to go to work this morning."

Some of those things are fairly advanced but with Apple's tight software integration and 5 years of Siri use I would think Apple could have taken it farther. And all this is ignoring the accuracy rates of speech recognition.


------
Some super cool things that could leverage app integration would be thinks like:
  • "Order my usual pizza from X."
  • "Open X files and send them as a PDF to XX"
  • "Back up my system to Time Machine and then put the computer to sleep."
  • "Retrive [file name] from my last time Machine backup."
  • "Copy [folder name] to iCloud Drive
 
Last edited:

g2only

macrumors member
Jun 25, 2015
43
21
USA
I use it for a part time pizza delivery gig I work a couple nights a week...UGH! Siri will give me routes OVERSEAS sometimes when I even give the city/state(?!?) in the "route me..." statement...I wished I knew how to log the response/routes to submit the issues to Apple/Tim Cook/ANYONE that will listen. I can't believe that the 'AI' would not check every possibility for a street WITHIN the city stated BEFORE going outside of that area. I'm talking like as simple as 'Main street' or '4th Street NW' (Add city/state--which I found out early on after much frustration thinking it would check in my CURRENT SURROUNDINGS without adding the city/state info). YES, I agree with Walt and others that posted here--simple things like alarms, texts, and appointments: no problem. Asking questions that take a 5th grade intelligence level: good luck!

Ok...rant over...for now ;)
 

akfgpuppet

macrumors regular
Feb 5, 2011
204
639
The 831
In my ideal world I would like Siri to work sort of how JARVIS works in the Iron Man movies. Using "Hey Siri" is the first step in my opinion, but because Siri requires an internet connection to work it really limits that ability. Also no multi-lingual support?
 

BugHunter

macrumors member
Mar 18, 2007
64
106
In my case he is totally right about "people just gave up" to ask Siri more advanced questions, I just assume it wouldn't be able to answer that.

I'm reminded when some years ago one of the Apple execs said something along the lines of
"Now nobody asks about a having a blu-ray drive in their mac anymore. I think we made the right choice".

Right choice or not, after 4 years of refusing to put a blu-ray in, the fact that everyone gave up asking isn't validation that it was the right choice.
 

mantan

macrumors 68000
Nov 2, 2009
1,747
1,054
DFW
I love the 'continue to improve' bit. Other than roll out a few lame party tricks around an announcement, Siri is just as limited and unreliable today and it was when it launched. It's great for setting timers...or very very simple tasks....but the frequency that it misunderstands requests or is unable to pull up basic information leaves it light years behind Google or Cortana.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.