Siri on HomePod Asked 800 Questions and Answered 74% Correctly vs. Just 52% Earlier This Year

[AstroRob]

I have one and it is the least used between HomePod (sounds better with a small footprint) and Alexa (more skills). Alexa is used the most because it is cheap and in every room.
[doublepost=1545343341][/doublepost]
You hit on a lot of the differences, but the fact that Siri is built into iOS, CarPlay, WatchOS, and Mac gives it a much larger platform than the Dot. I know there are apps that give you some of this type of compatibility, but they don't compare to just saying "Hey Siri".

For home use, the other major differences are:

Echo:

1. Some have Bluetooth in and out (not simultaneously)
2. Some have aux out

HomePod

1. Airplay 2 integrated into the Control Center on iOS and iTunes
2. Voice Control of Airplay2 devices
3. Superior sound quality in a very small footprint

I must admit I was focused on home use in my post, but the truth is I use Siri extensively on my phone and in the car. It has worked very well for audio controls (like skipping over ads in podcasts), hands-free text reading and replying, and on the fly navigation. None of that is even possible with Alexa.

Otherwise I have no point of comparison for the relative utility of Google Assistant on an Android phone.

 

[Tech198]

So, Siri's getting smarter

What if you don't use Homekit ?

'it ain't working'

 

[hans1972]

Does Apple even believe this propaganda?
Come on. Siri can’t process a fraction of what the google assistant can do. Sure Siri can play music when you ask but that’s really it. It’s still very basic compared to other virtual assistants.

You are contradicting the whole article and yet you provide no evidence at all for your opinion. Why should I trust you over Loop Ventures?

 

[Jedwardoo]

Expect Siri to keep improving, especially when they stole "John Giannandrea" from Google.

Siri on my homepod understands the question about 70% of the time and ignores the question about 30% of the time.

[doublepost=1545348787][/doublepost]It's from $349, now it's on sale $249 and no tax for some states. B&H https://www.bhphotovideo.com/c/product/1394582-REG/apple_mqhw2ll_a_homepod_space_gray.html

Why do we even talk about any of these percentages like they're even remotely acceptable?

If your keyboard only produced the correct character 80% of the time, or your touchscreen discarded 20% of touches, or your speaker only streamed 80% of a song, not a soul would be okay with that.

Siri on your iPhone or Mac is a funny novelty. The moment it becomes the only way you can interact with a device? Who on earth would find that acceptable? Maybe you'd be willing to buy such a device if it was priced like a whoopie cushion or silly putty (so, you know, ~$5), but for $300?

And this isn't even getting into the fact that this basic test is EASY! We're not expecting the devices to be productive contributors every conversation - these are tailored queries - softballs - meant to be easily within the realm of what the devices are supposed to be capable of doing!

 

[phpmaven]

Maybe, but with skills Alexa becomes much more capable. That influences why I think Alexa is far ahead of Siri.

Either way, there is no question GA is the best in the business and it's not particularly close.

13% behind is actually pretty close, especially when you consider that Siri gained 22% since the last test. I would imagine Apple will close the gap before long.

 

[AustinIllini]

13% behind is actually pretty close, especially when you consider that Siri gained 22% since the last test. I would imagine Apple will close the gap before long.

I'll believe it when I see it.

 

[genovelle]

Still unacceptable for the company that pioneered the virtual assistant.

Siri had a lead and it is now miles behind Alexa in intelligence, which in turn is behind Google Assistant by quite a ways

Not according to this test.
[doublepost=1545365988][/doublepost]

Why do we even talk about any of these percentages like they're even remotely acceptable?

If your keyboard only produced the correct character 80% of the time, or your touchscreen discarded 20% of touches, or your speaker only streamed 80% of a song, not a soul would be okay with that.

Siri on your iPhone or Mac is a funny novelty. The moment it becomes the only way you can interact with a device? Who on earth would find that acceptable? Maybe you'd be willing to buy such a device if it was priced like a whoopie cushion or silly putty (so, you know, ~$5), but for $300?

And this isn't even getting into the fact that this basic test is EASY! We're not expecting the devices to be productive contributors every conversation - these are tailored queries - softballs - meant to be easily within the realm of what the devices are supposed to be capable of doing!

Humans are actually wrong more often without the help of devices.

 

[dilbert99]

Still unacceptable for the company that pioneered the virtual assistant.

Siri had a lead and it is now miles behind Alexa in intelligence, which in turn is behind Google Assistant by quite a ways

Apple bought the virtual assistant, they didn't pioneer anything

 

[AustinIllini]

Apple bought the virtual assistant, they didn't pioneer anything

There wasn't a worthwhile virtual assistant baked into a phone until Apple did it with iPhone 4s. That's pioneering. That being said, they squandered whatever lead they had years ago.

 

[DNichter]

I use Homekit extensively, and it is perfect when I use the home app, but if I tell Siri on my HomePod to turn off the backyard lights, inevitably only some of them turn off. Or turn on. But if I tap that button, no problem. What gives?

I apologize if this is obvious to you, but it is all about what you call the lights in your Home app. If certain lights/devices are named similarly or many names have Living Room in it or something like that, it can get confused with what you are requesting. I found it best to name everything by the room and what the device is - example, Kitchen Lights or Bedroom Fan, etc.
[doublepost=1545400850][/doublepost]

So, Siri's getting smarter

What if you don't use Homekit ?

'it ain't working'

If you don't use HomeKit, you are better off using an Echo or Google Home. HomeKit, for me, has advantages that make it well worth it though.

 

[WhoDaKat]

Still unacceptable for the company that pioneered the virtual assistant.

Siri had a lead and it is now miles behind Alexa in intelligence, which in turn is behind Google Assistant by quite a ways

This test doesn't show Siri "miles behind" Alexa.

 

[AustinIllini]

This test doesn't show Siri "miles behind" Alexa.

It's based on a number of factors, but compatibility and skills are matter. Alexa just has a lead now.

Plus, you can get Alexa for significantly less than any Siri device, which just makes it significantly more accessible.

Apple was years ahead and they completely squandered any lead they had and then some.

 

[rocknblogger]

Still unacceptable for the company that pioneered the virtual assistant.

Siri had a lead and it is now miles behind Alexa in intelligence, which in turn is behind Google Assistant by quite a ways

They didn’t really pioneer Siri. They bought it and integrated into iOS.
Nytimes article on Siri purchase

 

[AustinIllini]

They didn’t really pioneer Siri. They bought it and integrated into iOS.
Nytimes article on Siri purchase

Again, before Siri on iPhone, there was no native digital assistants on a flagship device. Apple undoubtedly pioneered the assistant on a device.

 

[The Game 161]

HomePod works for what i need it to do for general tasks.

 

[falainber]

13% behind is actually pretty close, especially when you consider that Siri gained 22% since the last test. I would imagine Apple will close the gap before long.

Don't be fooled by these metrics. It's easy to come up with questions/phrases that none of these tools would answer. It's possible that were these tasks more difficult the difference between the assistants would increase dramatically.

These tests are still useful in that they show the progress.

 

[dilbert99]

This test doesn't show Siri "miles behind" Alexa.

When I look at the results from the different categories, the homepod is stronger in categories where it does not need AI smarts. Like commands where it is really specific like directions or commands in the device.
But where the question is open to interpretation like Information section, you can see that the homepod/siri has a lot of catching up to do.

 

[tridley68]

Glad to see Siri is getting somewhat smarter.

 

[rocknblogger]

Again, before Siri on iPhone, there was no native digital assistants on a flagship device. Apple undoubtedly pioneered the assistant on a device.

How can they have pioneered it when Siri was available on iOS as an app? They simply bought it and coded it into iOS. I’m sorry but I don’t view that as pioneering.

 

[Shanghaichica]

Siri really does need to improve though. I asked it today what time Sainsbury’s closes tomorrow. The HomePod told me it was closing at 10pm which I knew was incorrect because it is Christmas Eve tomorrow. I asked my google home mini and it said because tomorrow is Christmas Eve Sainsbury’s will close at 6 pm which is the correct time.

 

[Mr Retina]

Does Siri on Homepod still not understand different peoples voices like it does on every iOS device, or can people still read /send messages If you're the main user?

 

[The Game 161]

You can turn the feature on or off in terms of allowing others to read texts

 

[Uofmtiger]

Siri really does need to improve though. I asked it today what time Sainsbury’s closes tomorrow. The HomePod told me it was closing at 10pm which I knew was incorrect because it is Christmas Eve tomorrow. I asked my google home mini and it said because tomorrow is Christmas Eve Sainsbury’s will close at 6 pm which is the correct time.

I think people that buy the HomePod should do so knowing that it is limited in some of the areas where Google excels.

It is the trade off if you want great sound with a small footprint and Airplay 2 voice control capabilities. If people are okay with sharing their information with Google, then they typically sell them for $30 and give you enough goodies that it can practically be free. I got my Mini a year ago for $30 and they threw in a Best Buy gift certificate (I think it was $25, but can't remember the exact number) and 6 months of Tidal Premium ($120 value).

Personally, I prefer the Echoes to the Mini, but they can be pretty stupid, too. I think it really depends on how you want to use these devices and it is possible to just have more than one service in the house. I mainly use my HomePod for music, lights, and controlling Airplay. It was worth the money for just those benefits. I also have Echoes and they serve a different purpose. Almost like having a steak knife and a butcher knife in the house rather than relying on a Swiss Army knife for everything. I would love for Siri to do some of the skills that I can do with the Echo, but because of the price of the HomePod, I can't see myself putting it in every room (even those I visit infrequently) or my bath (if a $30 Echo dies from moisture, I can just grab another one).

 

[Shanghaichica]

I think people that buy the HomePod should do so knowing that it is limited in some of the areas where Google excels.

It is the trade off if you want great sound with a small footprint and Airplay 2 voice control capabilities. If people are okay with sharing their information with Google, then they typically sell them for $30 and give you enough goodies that it can practically be free. I got my Mini a year ago for $30 and they threw in a Best Buy gift certificate (I think it was $25, but can't remember the exact number) and 6 months of Tidal Premium ($120 value).

Personally, I prefer the Echoes to the Mini, but they can be pretty stupid, too. I think it really depends on how you want to use these devices and it is possible to just have more than one service in the house. I mainly use my HomePod for music, lights, and controlling Airplay. It was worth the money for just those benefits. I also have Echoes and they serve a different purpose. Almost like having a steak knife and a butcher knife in the house rather than relying on a Swiss Army knife for everything. I would love for Siri to do some of the skills that I can do with the Echo, but because of the price of the HomePod, I can't see myself putting it in every room (even those I visit infrequently) or my bath (if a $30 Echo dies from moisture, I can just grab another one).

Oh I agree. I just wish Siri was a bit smarter but you are right Alexa isn’t much smarter than Siri but makes up for it with skills. I think Music and integration with iOS devices are the HomePods strong points and as smart as the google home mini is I’m not tempted to buy another.

 

[Uofmtiger]

Oh I agree. I just wish Siri was a bit smarter but you are right Alexa isn’t much smarter than Siri but makes up for it with skills. I think Music and integration with iOS devices are the HomePods strong points and as smart as the google home mini is I’m not tempted to buy another.

Me neither. As seldom as those type of things pop up, I can just use my iPhone to find the answer. Luckily, Google Assist can be downloaded for free.