After yesterday’s launch of the official Corona Warn-App, we started a crowdtest of the app that ran for 24 hours.
231 testers across all German states participated and tested the app on 101 devices from 15 different manufacturers running on different operating system versions.
If you'd like to read this article in German, click here.
Corona App Test - The Results
Overall, the Testbirds Crowd didn’t find any critical bugs and gave the app a high rating from a UX perspective.
The app received an overall rating of 4.3 stars from our testers and an NPS score of +49. (The NPS score is one standard measure in the field of UX testing and is calculated on how likely it is that a customer would recommend a company, product, or service to a friend.)
Most of the bugs found were only minor issues, such as spelling mistakes. Nevertheless, we’ve gathered all the bugs found and will be sending the list to the app developers. Generally, we can say that the app is highly developed already - more so than most of the early app versions we normally see in our daily work.
We also asked our testers if they’ll continue to use the app after the test as well and 85% said that it was likely or very likely that they would.
Those who said they wouldn’t had three main concerns:
- Data security
- Battery consumption
- Effectiveness of the app as a measure to fight Coronavirus
Although the government and the app developers have already addressed those user concerns, especially regarding data security, it seems there’s still room to further improve. Addressing battery consumption and giving more details on why and how the app helps to break infection chains is one recommendation we derived from the test results.
But still, most users are very positive about the app (these quotes have been translated):
“All in all, very simple and stable! Great."
“I think the Corona Warn-App is very good because you’re warned by a message if you’re at risk of infection. I also like the design a lot and everything is explained well and in detail, so I would recommend this app to other people.”
“The app is designed very clearly and limited to the bare essentials. This allows good usability for all potential customers.”
Those voices show that the German federal government, together with developers of the app, SAP and Deutsche Telekom, heard the users’ concerns and tried to minimize them as much as possible.
“The results of our QA and UX test of the Corona app are very positive, which makes me happy and a bit relieved as that should help convince people to download this important app. From a Testbirds perspective, I can say that this first version of the app is already on a very high quality level. You can literally see that a lot of experts worked together here. Normally, we find a lot of critical bugs in the first versions of apps and usability is usually far from the level we have here, so a lot of experience was put into making it.”
Philipp Benkler, CEO and Co-Founder of Testbirds
Further Information on the Corona Tracing App
Yesterday (June 16th) was the official launch of the Corona Warn-App in Germany and it’s now available for download in the app stores. The app was long-awaited and will help break chains of infection as early as possible. To ensure that the app has a real benefit, literally every download counts - so far the app has been downloaded over 1 million times.
As data security remains the biggest concern among users, I recommend reading this FAQ or watching the following video (German only) as it gives a clear explanation of what data is saved and how.
We’ve already helped on Corona-related projects like the Wir-vs-Virus hackathon, where we supported the development teams with free crowdtests, and we continue to provide pro bono testing for solutions tackling the Coronavirus.
If you’re interested in the topic, read our blog post: Digital Hackathon #WirvsVirus
We really recommend downloading the app and using it to break infection chains, contributing to stopping the virus and helping us all return to a normal life again, as soon as possible.
Disclaimer: We have not received payment for conducting this test or writing this article. We do this because we really see the importance of this app and want to help build trust in it.
Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.
© Testbirds GmbH. All rights reserved.