Siri's ranking in virtual assistance land.

Discussion in 'iPhone' started by bonskovsky, Feb 20, 2013.

  1. bonskovsky, Feb 20, 2013
    Last edited: Feb 20, 2013

    macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #1
    [​IMG]


    A study published yesterday by Indiana-based Butler University compared the performance of a range of search engines and Q&A sites on mobile devices. It found that ChaCha delivered the highest quality responses consistently across the largest group of categories and question types. It has been widely believe among the Apple community that the current version of the software is not in it's final state. It's almost akin to Apple's Maps, that had been rushed out before it was really ready. Popularity can hurt a brand, I've seen this happen again and again, it's this habit they've gotten into where they're forced to release something great year on year on year. Apple cannot catch up.

    Both Siri and Maps are in unfinished states.

    I tried this for myself, little did I know anything about Chacha, but it did give legit answers on things that I was actually interested in, which didn't happen to be Sports or Movies by the way.
     
  2. macrumors 68020

    Joined:
    Oct 14, 2011
    Location:
    Ohio
    #2
    Cha-Cha is still in business? Wow, I'm surprised. My wife used to work for them as one of the respondants, she quit because things were going downhill with them slowly.
     
  3. macrumors 6502a

    Prime85

    Joined:
    Mar 1, 2012
    #3
    That accuracy of 37% shows that this is a horrible study. Siri has to be at least 80% accurate.

    Don't believe every study you read.
     
  4. Guest

    Joined:
    Jul 29, 2007
    #4
  5. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #5
    The most nonsensical thing that Siri does is direct you to Google. I mean, I'd rather get an answer that sounds almost like something I wanted to know. Chacha will give you that.
     
  6. JAT
    macrumors 603

    Joined:
    Dec 31, 2001
    Location:
    Mpls, MN
    #6
    It's horrible for me. 37% would be awesome.
     
  7. macrumors 68000

    virginblue4

    Joined:
    Apr 15, 2012
    Location:
    United Kingdom
    #7
    I can honestly say Siri is 99.9% accurate for me. I never had any problems and neither does anyone that I know.

    I simply don't understand how so many people can be having problems? :confused:
     
  8. macrumors demi-god

    ChristianJapan

    Joined:
    May 10, 2010
    Location:
    日本
    #8
    Where do you have the numbers from ? Did Siri told you ?

    I still struggle with Siris voice regocnition and available "knowledge" outside US. Right now not much more then a fancy toy; but high potential.
     
  9. macrumors 68020

    Joined:
    Mar 4, 2007
    #9
    Was this a comparison of virtual assistants, or just search engines with voice recognition? It makes me wonder what people think Siri is meant for. Personally I don’t have much need for Siri to perform a voice web search, rather I use it as a virtual assistant. I find that Siri does a great job at handling taking notes, reminders, appointments, timers, alarms, SMS, email, navigation, etc… Basically it excels in the areas that I want to use hands free.
    That doesn’t mean Siri is perfect. I’d love to see it be a better research assistant, but interacting with my personal information is more important.
     
  10. bonskovsky, Feb 20, 2013
    Last edited: Feb 20, 2013

    thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #10
    I understand why Apple shut down marketing for Siri and used a different campaign, almost as if they took a step back and said,"Okay, let's be realistic this time."

    The first marketing for Siri was completely and irreverently false.

    I don't know when this program is going to actually become something of which I can dedicate my attention to, but currently. I don't care for it.
     
  11. macrumors 68020

    Joined:
    Mar 4, 2007
    #11
    For me Siri is more accurate then Google Now, but I don’t have any noticeable accent. From what I gather Google is much better at recognizing accents.
    BTW – I find Siri can not understand me unless it is using the built in noise canceling mic. It struggles when using the wired or Bluetooth headsets.
     
  12. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #12
    The thing about Siri is that it's not three-dimensional, it serves one purpose: to do things one would normally do only with voice control.

    How is it a virtual assistant when it says the exact same things over and over again. Like a real toy.

    It seemed like back then it had more to say, but now, the responses seem to have been cut back to about no more than 4.
     
  13. macrumors member

    Joined:
    Dec 13, 2010
    Location:
    R.I.
    #13
    The only thing Siri ever does right for me is send a text and initiate a call other than that she is almost useless. To get answers I would rather pull out now or the wolfram app (yes I know they are both part of Siri services) but she never fully understands some what complex sentences you have to have a convo with her to do most things right. And by then I could of found it easier and faster using other methods. I agree with this study google now is better but still not perfect.

    And saying Siri is not in its finale stage is an excuse. I think if you ask all the other services they are always continuously upgrading. So they are all not in there finale stage.
     
  14. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #14
    There had been rumors that Apple's recent Siri commercials served as admittance that Siri is a joke. Do you think there's some truth to it?
     
  15. macrumors 68000

    vastoholic

    Joined:
    Jan 28, 2009
    Location:
    Tulsa, OK
    #15
    link? Source?

    If you use Siri for what it's made for (a personal assistant to streamline your daily activities) and not a random useless fact finder, then Siri is great. Yes, it still has it's moments for me when the voice recognition messes up a few words in my sentence, but overall it's been great.
     
  16. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #16
    Suddenly Apple gets that Siri is a huge joke

    That's the story that multiple news sites ran. I was disappointed because it's not what I wanted to Siri doing. It wouldn't just be a useless fact finder. I think Evi effectively proved what that direction will take the company and the user.

    But doing the things that it currently does in a smarter way. Part if the reason people respect Siri is because if the characterization they gave it. So it must be approached in many different ways.
     
  17. macrumors 68000

    vastoholic

    Joined:
    Jan 28, 2009
    Location:
    Tulsa, OK
    #17
    I'll have to read more into what that person was suing Apple about. They thought the commercial was misleading because they thought it could do more? I'm kind of confused.

    I think Siri has a ways to go before being as useful as Apple wants it to be. I should have stated in my other posts that the few times I use it it's been great. I don't even use it to it's full potential or as much as I want because I just don't have a lot of things I need siri for besides hands free texting or using it with maps.
     
  18. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #18
    We're talking about a virtual assistant who's command is your wish. There's an infinite amount of things a technology like that could do, but we're only bound by its intelligence.

    That binding has proved to be substantial.
     
  19. macrumors 65816

    Joined:
    Mar 27, 2009
    #19
    Apparently the author's never tried ChaCha before. $100 says if the author actually asked them a question not related to entertainment, he'd get an off-topic answer.

    Besides, it's kind of unfair to include human-run services in ranking virtual assistants. Not only that, but ChaCha doesn't do everything Siri can.
     
  20. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #20
    It's funny that they would actually put "virtual assistant" for Siri and not structured data, crowdsourcing, or algorithm. Yes, with cha-cha the answers are a tad bit off-topic. But I get more of a sense that it understands what I'm saying than with Siri.

    I don't really trust Siri.
     
  21. Guest

    #21
    Don't worry guys, I haven't heard of this University so I doubt the results are reliable.
     
  22. macrumors 68020

    macingman

    Joined:
    Jan 2, 2011
    #22
    No way is Siri 80% accurate. It's accurate if you ask one of the few pre defined novelty sentences but once you start actually giving it more complicated commands it doesn't work at least 80% of the time.
     
  23. thread starter macrumors 6502

    bonskovsky

    Joined:
    Dec 31, 2012
    #23
    Yes, 50% is the base here. Never
     
  24. macrumors 68040

    Wicked1

    Joined:
    Apr 13, 2009
    Location:
    New Jersey
    #24
    Well I just hope Apple has something better for Siri planned this year, because Scott Forstall's presentation of Siri can do sport scores and look up places to eat was a total waste of time.

    Glad he is gone, could not stand listening to him, let Tim, Jon, Bob, and Phil do all the talking, they are easier on the ears to listen to anyway
     
  25. macrumors 604

    cynics

    Joined:
    Jan 8, 2012
    #25
    Well if YOU never heard of Butler that must mean something! Lol

    Seriously though, its a university if Indianapolis I believe. Regardless I've heard of it.
     

Share This Page