A test conducted on several voice assistants shows the lead taken by Google on its competitors. The assistant answered 800 questions better than Siri, Cortana or Alexa.
Which vocal assistant answers most often next to the plate? If one believes the observations of the venture capital firm Loup Venture, Alexa is the assistant who responds the least correctly, facing his competitors Google Assistant, Siri or Cortana.
On July 26, 2018, the group released its annual voice assistant test: to determine which one is the most appropriate, analysts Gene Munster and Will Thompson asked 800 questions to Siri, Google Assistant, Alexa, and Cortana. They explain that the assistant of the firm of Mountain View did the best out, answering correctly years 86% of the cases.
ON SMARTPHONE ONLY
The test of the Amazon Echo had already evoked what this study confirms, namely the difficulty of Alexa in answering simple questions. Nevertheless, this time the company has focused only on voice assistants embedded in smartphones – it plans to test them both on smartphones and connected speakers in the future.
The test was conducted with Siri on iOS 11.4, on Google Assistant since a Pixel XL, on Alexa and Cortana since their application on iOS.
DID THE ASSISTANT UNDERSTAND AND ANSWER CORRECTLY?
To determine whether the assistants were able to answer, the analyses established their ranking according to two criteria: “1. Did he understand what was asked of him? 2. Did he give a correct answer? “
The questions asked of the assistants were about five areas: questions about location, online ordering, navigation, information requests, and orders (for example, to ask the assistant to a reminder).
GOOGLE ASSISTANT STANDS OUT
In addition to answering the questions most often, Google Assistant also understood the 800 questions that were addressed to him. For his part, Siri misunderstood 11 questions, and Alexa 13. Cortana was the worst student, with 19 misunderstood questions.
“Google Assistant has the advantage in all categories except the order. Siri’s advance on Assistant in this category is odd since they are both embedded in the phone’s OS rather than being in a third-party application (like Cortana and Alexa), “note analysts.
The conclusion of these tests led the company to note that voice assistants seem to be improving faster and faster: “We are impressed by the speed with which technology is advancing. Many of the issues we had last year were eroded by improvements in natural language processing and inter-connectivity between devices,” said Gene Munster and Will Thompson.