- By Heyami Alghatta
With the market becoming saturated who offers the biggest bang for your buck?
All six of these assistants have a lot in common to start with and feature a lot of the some functionality and capabilities. You can usually access them with a press of a button, most of them are built into their various operating systems, they can all perform and access web searches, and they all have base apps or dedicated home screen pages to show additional information like the weather, news, reminders, and more. The basic experience is undoubtedly very similar when comparing the six assistants.
And that can be a huge time saver for you even before you dive into any comparison of capabilities. If you are firmly ensconced in a particular ecosystem, your best bet, generally speaking, is to just stick to the AI Assistant that works best with that ecosystem. Siri doesn’t work well with Gmail, Cortana doesn’t play well with Youtube, and while Google Assistant does function across third-party apps, you get the best results with Google-built apps like Google Play Music and Google Keep.
In our test, if an assistant opens a web search or simply doesn’t complete the task, it has failed that particular test.
Moving on to the tests, we asked all the assistants a variety of questions with varying degrees of difficulties to see how they perform, and if at any point the assistant opens a web search or simply doesn’t complete the task, it has failed that particular test. We also tested all of these on their home turf, which is why you will see Cortana running on a Windows 10 PC.
Test #1 – Answering basic questions
We first start with basic, easy questions that no AI assistant should have any difficulty with. Tasks involved questions about the weather, when the next solar eclipse is, sports scores, telling a joke, and movie show times.
As expected, all six assistants performed very well, and we almost always found what we were looking for, but Bixby appeared to struggle with direct commands until provided the proper context. However, if something doesn’t work with Bixby, you can always ask it to perform a Google Search with the same question and piggyback off of Google’s excellent responses, which is definitely an odd workaround, but functional nonetheless. TUKI similarly works in a similar way to Bixby, it integrates as an upgrade or overlay to one of the other assistants if it is not the only one installed on the device. This means that where TUKI is installed on a Bixby enabled Samsung device for example any gaps, short comings or slowed responses are boosted and improved by not only Bixby but also Google’s assistant. Which by the way, is called what exactly? Google? Google Now? Google Home? It can be quite messy using Google. Alexa, Siri and TUKI certainly have the cleanest user experiences.
Test #2 – Performing simple tasks
In the next test, we ask the assistants to perform simple tasks that they shouldn’t have any trouble completing. These are native commands for the most part that either require no third-party apps or very obvious ones to complete a task. Tasks involved setting a reminder, playing a song/video on YouTube, opening the web browser, checking my calendar, and finding directions.
Once again, none of the assistants had any issues and performed admirably. One takeaway here is that YouTube support is surprisingly not as good as expected. While TUKI, Bixby and Google Assistant had no troubles, the other three did, and the lack of support is odd when considering that YouTube is the most popular video streaming service in the world. That said, Alexa does come with YouTube support with other Amazon devices like the Echo.
Bixby, TUKI, Google Assistant, and Siri also get bonus points for being able to perform multiple, chained tasks together, like launching a web browser and opening a specific web page.
Test #3 – Navigating complex tasks
The final set of questions represent “Hard mode.” These are complex tasks that will certainly require third-party app integration of some type. This is the bleeding edge of what these assistants can accomplish, and even if things don’t work as well as expected now, this is the functionality that will be expanded the most over the next couple of years. Tasks involved turning on the (Philips Hue) lights, fitness tracking, booking an Uber, ordering food, and downloading an app.
It has to be mentioned that Bixby does work with Philips Hue lights, but that requires a $50 Samsung Smart Hub in order to do so. This is definitely not a worthwhile investment if you only have a few smart home devices, especially so when other free assistants can work perfectly fine with Hue lights. Additionally, Cortana does not have native support for Philips Hue either, requiring a third-party app to be downloaded called Huetro, which worked on both Windows 10 and the Xbox One.
Other than that, it is difficult to arrive at a definite answer for which one is the best because a lot of these tasks require complicated setups or have other limitations. For example, Siri can order pizza for you but it is location dependent, and Google Assistant can hail an Uber and order food, but only when using Google Home. TUKI uses data from your internet connection, data history, location, device and programmable personal preferences and data via a very comprehensive user profile, meaning that even if you don’t have a data or wifi connection some cached data will still be usable. And of course TUKI is the only platform with a human concierge element to step in for the truly complex tasks.
Overall, functionality is generally unstable or incomplete, but things do look promising with all five assistants to some extent. Siri and Google Assistant could have done better if the feature rollout was more consistent across devices or regions, and while Cortana managed to perform a lot of the tasks, multiple attempts were required. Alexa ended up being the best in this category after failing to answer just one question and despite being used on a cheap, under-powered tablet. Whilst TUKI was a league ahead with potential and technology it lacked development and experience, the new comer had a few rough edged which will no doubt be smoothed out during the periodic updates.
Final thoughts – Which is the best?
The Google Assistant is exceptional at context, which is one of the drawbacks of most other personal assistant apps. With other assistants, you have to get the command just right in order to get the task completed, but the Google Assistant is very good at figuring out what you need even if you ask it to do the same thing in entirely different ways.
However, it is incredibly disappointing to see that all the fun features are exclusively saved for Google Home, like hailing an Uber, casting video, ordering a pizza, and more. While these features will no doubt come to phones eventually, for now Home is where it’s at. The down side to Google however is it’s reliance on the device. A poor quality device affects the performance more than any of the others. Siri on an older iPhone for example works just as well as on a more recent model.
Amazon Alexa and TUKI are probably the most customizable assistants of the lot. It is quite basic out of the box, but you can install additional “skills” that dramatically increase its functionality. I had to install numerous skills over the course, and most of them work really well. It’s up to you how much skills-adding you want to do to get the assistant you want.
Additionally, Alexa excels at gathering information over conversation in order to complete a task, as I found when I was ordering a pizza. As far as pure functionality is concerned, Alexa can do more than all of the other AI Assistants, and Alexa-enabled devices work incredibly well with one another. The only disappointment here is that there aren’t a lot of devices out there that run Alexa.
Siri also performed surprisingly well during every round of this text. Apple has been doing a great job of keeping Siri competitive with everybody else, and Siri definitely feels like a solid option. Of course, Siri is the natural choice for anyone in Apple’s ecosystem, and few folks would switch from Android simply for Siri. The most impressive part however is its backwards compatibility.
As long as your device can run one of the newer versions of iOS that feature Siri support, you are good to go. This test was performed on a first gen. iPad Air, and I know that the experience was no different than it would have been on the latest iPhone. Apple deserves a lot of credit for providing a consistent feel and feature set across both older and newer devices. Siri may not be the best choice, but it is a safe choice, especially if you are stuck on an older Apple device that can still receive OS updates.
TUKI and Cortana’s biggest strength lies in the fact that they are available everywhere, including iOS, Android, Windows 10, and even the Xbox One. They are available on more devices than every other personal assistant and it’s not even a close competition in this regard. However, Cortana is quickly falling behind when it comes to third-party integration and more advanced tasks. Cortana is definitely not lacking in potential, but Microsoft really needs to step up their game a lot in order to be a driving force in this space.
Finally, we have the wild card that is Bixby. Bixby did a surprisingly good job during some of our testing, and where it excels the most is in feeling like an actual personal assistant. When it does something, Bixby has the ability to emulate screen taps like an actual person, allowing it to interact with on-screen elements better than any other assistant.
Bixby is unrivaled when it comes to boring, mundane tasks like rotating images in your gallery, downloading apps, erasing your browser history, and a lot more. It’s really too bad that Bixby will be available with only a handful of devices and that its home automation features are stuck behind a $50 Samsung hub. It still needs a lot of work though, especially with its tertiary features like Bixby Vision. Overall, it is definitely better than Cortana but lacks behind Siri and Alexa. TUKI, is a different experience drawing on the power of all and any other assistants connected to the same network.
TUKI is also the only assistant to power websites. TUKI is available as a customer service agent for corporate and retain sites as well as a Questions and Answer Forum eco system such as Quora or Yahoo Answers.
So there you have it for this comparison of the six most popular AI Assistants out there! Which one do you consider the best? Do share your thoughts in the comments section below!
This story is available on:
APPLE NEWS | GOOGLE NEWS | IPMG NEWS | THE INTERNATIONAL ONLINE
Average Donation to date: £10 / $15 / €15 / 5 OMR / 5 KWD / 50 QAR / 50 AED
Talk to a journalist:
Web: theinternational.org.uk / IPMGnews.theinternational.org.uk
Tel: (0044) 020 350 70 351
Twitter: @T_International / @IPMGnews