Siri's Accuracy Continues to Improve as Apple Works to Reduce Reliance on Google

Discussion in 'MacRumors.com News Discussion' started by MacRumors, Dec 10, 2013.

  1. MacRumors macrumors bot

    MacRumors

    Joined:
    Apr 12, 2001
    #1
    [​IMG]


    Piper Jaffray analyst Gene Munster, who has regularly assessed Siri's accuracy in terms of correctly interpreting and answering queries, has issued the latest version of his Siri report card, noting that Siri has continued to improve under iOS 7, particularly in terms of being able to properly interpret questions being asked.
    [​IMG]
    The improvements in Siri's understanding come alongside but separate from Apple's continued efforts to reduce its reliance on Google, as evidenced by Siri's shift to emphasize Bing, Wikipedia, and WolframAlpha results. In Munster's most recent testing, only 4 percent of Siri's answers relied on Google, compared to 17 percent in August testing and 27 percent in December 2012.

    [​IMG]
    Click for larger
    Munster also compares Siri to Google Now, finding that the two services are now essentially tied in effectiveness with a "C+" score after Siri held a substantial lead in the year-ago testing. In the latest testing, Google Now held small leads in content areas such as commerce and information, while Siri performed significantly better for operating system controls.

    [​IMG]

    Article Link: Siri's Accuracy Continues to Improve as Apple Works to Reduce Reliance on Google
     
  2. OzyOly macrumors 6502a

    Joined:
    Jun 3, 2009
    Location:
    Melbourne, AU
    #2
    It still does like Northern (British) English though...
     
  3. NightFox macrumors 68020

    NightFox

    Joined:
    May 10, 2005
    Location:
    Shropshire, UK
    #3
    So even though its accuracy at understanding has gone up, the accuracy of its answers has actually got worse?
     
  4. roadbloc macrumors G3

    roadbloc

    Joined:
    Aug 24, 2009
    Location:
    UK
    #4
    Regretfully, Siri still doesn't understand me. Good job I have no real need for voice control.
     
  5. chirpie macrumors 6502a

    chirpie

    Joined:
    Jul 23, 2010
    #5
    I don't know, that net percentage increase (4% better) year over year seems kind of low to me. Am I the only one who feels that way? Not my field of study, so I'm not entirely sure if this is supposed to be impressive.
     
  6. Amazing Iceman macrumors 68040

    Amazing Iceman

    Joined:
    Nov 8, 2008
    Location:
    Florida, U.S.A.
    #6
    How could Un-Controlled Environment results for iOS 7 be 94% and 7%, which adds to 101% ???

    The same happens to Controlled Environment for iOS 6.
     
  7. Ventilatedbrain macrumors regular

    Joined:
    Nov 22, 2012
    #7
    I may be in the monitory here but I really find Siri to be very helpful especially when biking.. i ask it to read my texts and call someone etc .. Google now on my nexus 4 feels a bit distant
     
  8. AppleMacNerd macrumors regular

    Joined:
    Jan 23, 2013
    Location:
    United Kingdom
    #8
    I also noticed this! :confused:
     
  9. steve-p macrumors 68000

    steve-p

    Joined:
    Oct 14, 2008
    Location:
    Newbury, UK
    #9
    If the purpose really is to reduce reliance on Google, then maybe the effort would be better spent working on a search engine I can type stuff into, not just talk to.
     
  10. chirpie macrumors 6502a

    chirpie

    Joined:
    Jul 23, 2010
    #10
    I'll wager there's some overlap leeway. Or the rounding up/down just created a slight anomaly on the percentages.
     
  11. NachoGrande macrumors 6502a

    Joined:
    Mar 30, 2010
    #11
    I know one phrase is get correct 100% of the time. SIRI, you suck! After I get the message that SIRI cannot help me right now.
     
  12. Michael CM1 macrumors 603

    Joined:
    Feb 4, 2008
    #12
    When I got iOS 7 I did notice a pronunciation correction. There's a town nearby called Braselton, pronounced "Brah-zel-ton." Siri had been pronouncing it "Bray-zel-ton." It's correct on TBT directions now. But she still can't pronounce "sugar" like there's an h after the s.
     
  13. HurtinMinorKey macrumors 6502

    Joined:
    Jan 18, 2012
    #13
    This, and the eventual analog on Windows, will be the death of Google. Or at the very least, a breakup of its monopoly on search ads.
     
  14. Xenomorph macrumors 65816

    Xenomorph

    Joined:
    Aug 6, 2008
    Location:
    St. Louis
    #14
    Who made those charts?

    Randomly switched fonts and terrible kerning? Gross.
     
  15. lil' brudder macrumors 6502

    Joined:
    Jan 14, 2007
    Location:
    Minneapolis, MN
    #15
    There is no way these charts are accurate. Even when I speak as clearly as possible and enunciate every syllable, Siri understands me about 40% of the time.
     
  16. pasqualino macrumors member

    Joined:
    Oct 4, 2013
    #16
    in other news, company b is trying to improve their products.
     
  17. HenryDJP macrumors 603

    Joined:
    Nov 25, 2012
    Location:
    United States
    #17
    The one thing I will greatly defend Apple and Siri for is trying to understand people's voices. People either have a strong accent, speak with a lisp, speak too fast, speak too slow, speak with a low register voice, have an annoying voice, mumble their words, garble their words and most of all they try and use Siri in a noisy atmosphere along with any of the above.

    No matter what, it's still an electronic device and people just have to learn to speak properly based on the source or just don't use as you've appeared to do. You say you have no need for voice control, it's not just about voice control. Many times I need to look up sports scores, it's much faster and easier just to ask Siri the game stats than typing them in or opening an app and searching.
     
  18. Popeye206 macrumors 68040

    Popeye206

    Joined:
    Sep 6, 2007
    Location:
    NE PA USA
    #18
    I use to work with someone from Glasgow… heck, I couldn't understand them half the time…. especially after a few pints! :D
     
  19. HenryDJP macrumors 603

    Joined:
    Nov 25, 2012
    Location:
    United States
    #19
    I get 90% accuracy, I don't know what's going on with you.
     
  20. skoosht macrumors member

    Joined:
    Jul 22, 2011
    Location:
    Los Angeles, CA, USA
    #20
    Google search works nearly 100% of the time for me on my iPhone 4. Siri 0% hahaha....oh wait, apple says my phone can't handle voice search. tsk tsk apple.
     
  21. zombierunner macrumors 65816

    zombierunner

    Joined:
    Jan 18, 2011
    Location:
    UK
    #21
    Google voice does better than Siri if you have an accent .. I tried both .. Google seems to work more times than Siri .. Hopefully Apple can sort this out
     
  22. Simmias macrumors member

    Joined:
    May 22, 2010
    #23
    I have had the opposite experience. After seeing steady improvement in Siri, it has recently gotten worse and become almost unusable for me.

    Specifically, I use Siri a lot to play music in the car. I will say "Play Song X" or "Play Album Y". Siri used to be pretty good at hearing the name of the song and finding it in my music library. Now it frequently hear the names incorrectly. Even when it does hear the correct name, it will play a song with a completely different name or simply say "Sorry, I couldn't find that in your music". What do you mean you couldn't find David Bowie in my music??? It's right there!

    This regression is quite infuriating. Also, Siri still often fails to respond ("Sorry, there's something wrong") or take 20+ seconds to respond with the wrong answer. I believe we need to give all of Apple's web services time to gather data and make iterative improvements, but I have very little tolerance when they actually get worse over time.
     
  23. NightFox macrumors 68020

    NightFox

    Joined:
    May 10, 2005
    Location:
    Shropshire, UK
    #24
    Never defend a technology! Technology is meant to develop to serve the requirements/limitations of existing human behaviour; human behaviour shouldn't be expected to adapt to meet the requirements/limitations of technology.
     
  24. JHankwitz macrumors 68000

    Joined:
    Oct 31, 2005
    Location:
    Wisconsin
    #25
    Haven't you ever heard of the "new math"? It was all the rage back in the 70's and 80's. The kids from that era now work for the media, spewing forth whatever numbers they get without analysis or question.
     

Share This Page