We asked Google Assistant, Amazon 's Alexa and Apple's Siri 150 questions. Here's who won.

[tao]

OK Google, we get it. You are smarter than the other assistants.

 

 

This has been the subtext of recent Google I/O developer conferences. Google talked about its progress in taking on Amazon and Apple. In terms of market share, Google has a long ways to catch up. According to Voicebot.ai, a website that focuses on voice computing, Amazon has Alexa in some 12,000 connected devices, compared to 5,000 for Google and just 194 for Apple's Siri.

 

But in smarts, Google topped not just our informal survey, but many recent ones as well, including surveys from online marketing firm Stone Temple and investment company Loup Ventures.

 

We spent the weekend asking the same 150 questions to the Google Assistant on Google Home, Amazon's Alexa via the Echo speaker and Apple's Siri on the iPhone. Google answered correctly 80% of the time, compared to 78% for Amazon and 55% correct for Siri.

 

A quick caveat for our methodology—if Google and Amazon gave us a complete, audio answer to the question, that counted as a successful response. When an assistant said it wasn't set up to respond, or didn't know, that counted as a fail. And when Siri responded with a "Here's what I found on the Web," and a link to look it up ourselves, that also counted as a non-answer. (We tried some of those questions again with Apple's HomePod, which is a $350 speaker rival to the Echo and Google Home, but didn't fare much better. While it did answer one query, the rest returned with a "I can't get the answer on the HomePod" response.)

 

Our questions came from a variety of courses: we cribbed from the 800 questions posed in recent surveys by Loup, the suggested queries on Amazon, Google and Apple's websites to ask their assistants, and topics offered by social media.

 

Google, via the Home speaker, told us how to get to the nearest Mexican restaurant, what time the Avengers movie was playing at the cineplex, who won the Best Picture Oscar of 1989, the date and flight number of my next scheduled airline flight and the definition of a first cousin once removed.

 

What it couldn't tell us was also quite interesting. Some notable Google Assistant failures. It couldn't:

 

Read our latest G-mail email aloud. Which Siri could do, but not Alexa.

 

Google the movie "Back to the Future."

 

Tell me "Who was Jesus Christ."

 

Answer if aliens really exist and why cats have whiskers. (Alexa has answers for both and Siri was happy to tell me about Jesus.)

 

Alexa indeed was surprisingly strong when it came to hard core science factoids that Google excels in, like naming the melting point of gold, how far away the Moon is from the Earth and citing the weight of the Sun.

 

It can translate 'good morning' in German (all three can do this) and tell you how to say 'thank you' in Japanese. (As can Google, Siri can't.)

 

Both Google and Amazon can play your morning news briefings—Siri doesn't do this. Alexa can read recipes, and being that it's Amazon, also order paper towels, batteries, dog food or even shop for an iPad. Siri couldn't do any of this with audio directions, instead "Here's what I found on the Web," and links.

 

Google Home could do all the shopping as well, by sending you to Google Express, it's answer to Amazon, but it puts a $100 limit on purchases, so the iPad was out, but the other products could be sent.

 

With Siri, as always, it's a matter of managed expectations.

 

It generally could answer most of the questions posed by Apple on the Siri section of its website, like using it to call and text friends, set timers and appointments, relay information ("When is the L.A. Galaxy's next home game?) and tell what the weather would be like today, tomorrow and on the weekend.

 

But we've got some caveats. Apple suggests we ask Siri to play "the top song from 1985," on its website. Yet, when I ask, it says, "Sorry, I don't know what topped the charts on that date."

 

Google Home has come a long way since we first reviewed it in 2016 and it got so many questions wrong. We'd like to see simple improvements like learning how to "Google" information more effectively (the Back to the Future query was an easy one), read my latest e-mail and texts aloud, improve on sports stats ("What's Alabama's record this season?" was missed and learn how to answer the Jesus question.

 

To close the gap even more, Bret Kinsella, the publisher of Voicebot, which focuses on voice computing, thinks Google has done a great job showcasing the utility of the product —now it should be more fun.

 

"I'd like to see them humanize it more, have it do more things you can do as a family." like letting users know what's on Netflix tonight or adding more games.

 

But seriously, it's Apple that has its work cut out for it, not Google. And we'd like to offer a simple suggestion. Stop having Siri direct us "to the Web," and instead announce actual answers, just like Google Home and Alexa.

 

Siri's super low 55% response rate on our survey is due to the fact that it keeps offering non hands free, "Here's what I found on the Web," links, when its rivals offer true audio replies. For many of the questions, Apple is competitive. even when it's system clearly had the answers.

 

When asked to tell me where to get a car repaired on locally, instead of reading me choices, it sends links to the Firestone shop. Ask where to buy golf clubs and you get a link to a nearby golf course. Inquire about recipes for a Tom Collins drink or how to make banana bread, and Siri directs you to look it up online.

 

Apple has the data. If Amazon and Google could do it, there's no good reason why Siri couldn't join this party. Make that one shift, and the successful query gap could be closed significantly overnight.

 

< Here >