Siri Answers 83% of Questions Correctly in Test, Beating Alexa But Trailing Google Assistant

[FightTheFuture]

For all the anecdotal comments - I’m wondering whether you’re comparing using Siri vs Alexa or using the “Hey Siri” command.

[*]Local - Where is the nearest coffee shop?
[*]Commerce - Order me more paper towels.
[*]Navigation - How do I get to Uptown on the bus?
[*]Information - Who do the Twins play tonight?
[*]Command - Remind me to call Jerome at 2 pm today

And the responses:

What the heck is this? Not all of these look like prompts that Siri is programmed for. Look at the “Some things you can ask me:” screen on Siri. Those are examples which it’s programmed for.

 

[MallardDuck]

For all the anecdotal comments - I’m wondering whether you’re comparing using Siri vs Alexa or using the “Hey Siri” command.


What the heck is this? Not all of these look like prompts that Siri is programmed for. Look at the “Some things you can ask me:” screen on Siri. Those are examples which it’s programmed for.

Those are the ones in the original test.

Is there any way to activate siri other than the button or hey siri?

 

[ahall52]

There had to have been severe flaws in the planning, implementation, and/or analysis of this study.

 

[frifra]

Hey Siri, start a ten minute timer.

„I am sorry, there was a problem. Please try again“.

 

[Baymowe335]

I'm not sure about the methodology they used to reach these results, but my anecdotal experience is that Alexa does a MUCH better job than Siri on almost everything I've tried to use them for.

Well, it’s wrong to use anecdotal data.

I’m not saying this is the end all, but at least a methodology was used.

The “Siri Sucks” mantra here is not only unfair, but it’s also outdated. Siri has been improved A LOT, no doubt.

In my own anecdotal experience, Siri does every single thing I want almost every time.

 

[fishmongerer]

Does anyone else feel like this is crap? 99.8% of the time Siri doesn’t work for me (though my friends’ Alexa does). Period. It’s even worse when I try to use it and there are 2 or more apple devices in the vicinity.

Keywords may be Gene Munster. Who also claimed almost all young people prefer the iPhone, but time will tell in reality.

 

[digthewell]

I've found Google Assistant to be the most intuitive. Siri can probably follow basic device action commands, but ask Siri anything remotely complex and it utterly fails.

I'm not sure if Bixby is still under development, but it was the retarded cousin of other virtual assistants.

 

[MallardDuck]

I've found Google Assistant to be the most intuitive. Siri can probably follow basic device action commands, but ask Siri anything remotely complex and it utterly fails.

I'm not sure if Bixby is still under development, but it was the retarded cousin of other virtual assistants.

Google and alexa are definitely better, both at understanding and responding to commands, and at monetizing your data.

That's, unfortunately, the reason that Siri sucks...no direct line to revenue.

 

[johncarync]

They all are showing significant improvement year over year...

 

[Westside guy]

All I can say is - that 99%+ rating for “understood query” does not even remotely match my experience. For me, I’d estimate it falls somewhere in the 50-65% range.

 

[nwcs]

None of the assistants are perfect and people have different expectations on what one should be capable of. Having used all three, I’d say the results are about right. The Google one is best at interpretation and Alexa/Siri are roughly similar. I wonder how often those who trash a particular assistant have actually used it regularly in recent times to actually test their assumptions rather than confirm their own bias?

 

[nburwell]

I'm actually shocked (in a good way) that Siri answered more questions accurately than Alexa.

 

[neuropsychguy]

I love how quick people are to counter research with anecdotes as if anecdotes reflect reality (of course, research doesn't necessarily reflect reality either but we don't get to automatically discount research just because we disagree with results). I'm not sure how valid this study's methods were but it was at least a study rather than random MacRumors comments.

 

[JetLaw]

Well, it’s wrong to use anecdotal data.

I’m not saying this is the end all, but at least a methodology was used.

The “Siri Sucks” mantra here is not only unfair, but it’s also outdated. Siri has been improved A LOT, no doubt.

In my own anecdotal experience, Siri does every single thing I want almost every time.

Why? All of our experiences as users are anecdotal. That is literally what "user experience" means. So while I can't say whether or not I disagree with the logic they used to publish these data, I can say for certain that I disagree with the logic you used to criticize my comment.

 

[AppleHaterLover]

My Siri won't stop thinking I'm in the UK and reverting to that soft-spoken dude who always freaks me out.

It can't even figure out my location correctly, let alone a question

 

[digthewell]

Google and alexa are definitely better, both at understanding and responding to commands, and at monetizing your data.

That's, unfortunately, the reason that Siri sucks...no direct line to revenue.

Excellent point. I think the last point should be a big consideration while making a decision on which assistant to use.

 

[djcerla]

Siri’s accuracy in the Italian understanding of words and sentences has got incredibly better in the last year. Very very accurate.

I use it every day for a ton of tasks, almost every time she understands the question and acts accordingly. I started using it on the Mac as well for retrieving files and photos.

I guess the new head (ex Google’s AI and search chief) is improving things quickly.

 

[Jakewilk]

Why the heck does everyone think siri doesn't work? It works nearly every time for me... how many of you haven't used siri since 2013?

 

[deputy_doofy]

Strangely, "Alexa, turn on all the lights" is a fail, because one light is named "light" and the other is named "mini." It recognizes "all lights," but if I add a "the" into it... nope.

Siri gets this right. With LIFX bulbs, Siri finally wins at understanding context.

Beyond that, Siri either wants to point me to a useless wiki that I cannot read at that moment... or it offers me directions to Main Street on Mars, rather than the closest Main Street compared to where I am at that very moment.

Hell, Alexa will recite the alphabet forwards "like William Shatner" and will also recite it backwards.... it's beyond Siri's capabilities at the moment (her reply).

Siri also picks some seriously random music that I've never heard of when I ask for specific items already in my library. Sometimes it has worked out and I've added it. Sometimes it goes right to some ****** hiphop song where F<>K is the first word and I have kids in the car.

 

[pumpkinwhite]

Siri may have improved in its responses (though I’m skeptical), but it’s definitely lacking in voice recognition; especially for non-American accents (as is the case for me)

All the AI on accurate responses doesn’t mean much if it doesn’t understand your words.

Personally, I think google is the best on this front, while Alexa is a close second. Siri is a distant third. I’m personally invested in Alexa ecosystem now so don’t wish to change. But just testing the google recognition in the iPhone app, it’s clearly quite good . It’s very noticeable when you ask it to define an archaic or less common word. Siri almost never understands me.

 

[gnomeisland]

Siri on my XS is terrific at understanding me, but on my Apple Watch Series 4, it is DREADFUL.

Must be the microphone, because I can barely whisper into my iPhone to control my smart lights and it almost always comprehends. On the watch though, no matter how clearly I speak, it screws up half the time. It's gotten to the point I don't even bother.

I wonder if part of that is the neural engine in the A12. I don't use Siri much on my Phone (still with a 6) but both talking to Siri and the "silent", predictive aspects of Siri work very well on my iPad Pro 2018.

Which illustrates my biggest complaint about Siri—inconsistency. All my devices are Apple and they all have some Siri/AI elements in them. If I can't get the answer on one device (my HomePod is the typical culprit) why doesn't it automagically bounce the request to my watch/iphone/ipad/Apple TV which can?! I get that it is more complicated than it seems at first blush but isn't that the kind of thing that makes Apple . . . Apple?!

 

[Baymowe335]

Why? All of our experiences as users are anecdotal. That is literally what "user experience" means. So while I can't say whether or not I disagree with the logic they used to publish these data, I can say for certain that I disagree with the logic you used to criticize my comment.

You can't even aggregate the user experience that is poor, let alone the experience that is good.

There is literally no methodology to anecdotal posts that are on a forum designed for people to mostly complain. You also ignore millions of interactions that are positive because you can't capture them.

 

[MallardDuck]

None of the assistants are perfect and people have different expectations on what one should be capable of. Having used all three, I’d say the results are about right. The Google one is best at interpretation and Alexa/Siri are roughly similar. I wonder how often those who trash a particular assistant have actually used it regularly in recent times to actually test their assumptions rather than confirm their own bias?

Every time I travel, try to set alarms, reminders, call people from the car, etc. 50-70% success at best.
[doublepost=1565899827][/doublepost]

Why? All of our experiences as users are anecdotal. That is literally what "user experience" means. So while I can't say whether or not I disagree with the logic they used to publish these data, I can say for certain that I disagree with the logic you used to criticize my comment.

And I'm sure they did it in controlled environments, with little ambient noise, using people with precise diction, who knew they were testing it and carefully annunciated every word, with short pauses in between.
[doublepost=1565899935][/doublepost]

I wonder if part of that is the neural engine in the A12. I don't use Siri much on my Phone (still with a 6) but both talking to Siri and the "silent", predictive aspects of Siri work very well on my iPad Pro 2018.

Which illustrates my biggest complaint about Siri—inconsistency. All my devices are Apple and they all have some Siri/AI elements in them. If I can't get the answer on one device (my HomePod is the typical culprit) why doesn't it automagically bounce the request to my watch/iphone/ipad/Apple TV which can?! I get that it is more complicated than it seems at first blush but isn't that the kind of thing that makes Apple . . . Apple?!

I'll second that. How many times have you said a command, had it fail, then said it again (or multiple times) and finally it works?

It still refuses to reliably call numbers in my contact list. Call American Airlines Reservations results in 'here's what I found on the web for american airlines reservations' or another error about half the time....even though it's not only in my contacts, it's in my favorites!

 

[MisterSavage]

I'm really skeptical of these results. I use Siri all the time for sending text messages and setting reminders but it is godawful at questions about topics. A lot of times Siri will give me "here's what I found on the web" (if it's even relevant) where as Google Assistant will show me a correct answer. I just tried "How should you put out a campfire?" and Siri showed me info about a movie called Campfire.

 

[nwcs]

Every time I travel, try to set alarms, reminders, call people from the car, etc. 50-70% success at best.

It’s usually 90% for me. Maybe it’s the car environment? Maybe it’s how one asks? Lots of variables to factor in.