How the Crowd drives improvements to the Generali Mobility App
To meet the highest quality standards, the app had to run smoothly and be intuitive in its usability. This meant testing it in real-life conditions with a primary focus on whether it could be used without added instructions, was it compatible on different devices and operating systems, would it start automatically, could it differentiate between the user driving or taking another form of transport?
Download Case Study
“The test with the Testbirds Crowd helped a lot and we were able to further optimize our application and adjust it even better to the conditions in the real-life scenario. The testers found bugs we possibly would have not found by ourselves. As the project was realized very quickly, we were able to eliminate them before launching the app. With that we could ensure that it matched our high-quality standards.”
Generali Mobility app
The test consisted of three consecutive parts: first, the participants got navigated through the key masks of the application by following four use cases. For example, driving a certain distance by both their car and by public transportation or by foot. In a second part the testers had to give detailed feedback about their experience by answering ten open and closed questions and in the final step they were asked to independently and exploratively search for bugs by themselves.
Generali
Generali Deutschland is the second-largest primary insurance group in the German market, supplying solutions to help protect people from everyday risks while ensuring security and peace of mind. Their goal is to become a lifetime partner for their customers by offering innovative, individualized solutions, and services.
Client's needs
Telematics auto insurance or usage-based insurance is all about one thing: if you drive smoothly and responsibly, you pay less for your car insurance. Rather than have an expensive ‘black box’ installed in every car, Generali opted for a telematics smartphone app to check their customers’ driving behavior.
The app uses GPS data to track the car’s speed, braking behavior, and where and how the car accelerates. But how do you cost-effectively test the app when there are so many different models of cars and thousands of varied devices?
Testmanager bei Generali Deutschland
“How does the app work outside the lab and in nonideal conditions? Does everything run smoothly? How satisfied is the customer and is the app easy and intuitive to use? We wanted to sort out these kinds of questions with the help of crowdtesting.”
The testing difficulties were further multiplied by the many areas that the app would track, from the type of road being driven on, how often the car is driven, and when the user last drove the car. All to help improve the driving of their customers and reduce accidents.
Test setup
To meet the highest quality standards, the app had to run smoothly and be intuitive in its usability. This meant testing it in real-life conditions with a primary focus on whether it could be used without added instructions, was it compatible on different devices and operating systems, would it start automatically, could it differentiate between the user driving or taking another form of transport?
Additionally, it was essential that the actual driven kilometers were correctly captured, that messages were displayed correctly even without GPS or when the battery was low, that another app running at the same time didn’t affect it, the smartphone’s battery wasn’t affected, and that there weren’t any display errors or other malfunctions.
To test the application as realistically as possible the participants had to have a valid driver‘s license, their own car, and a smartphone.
During the selection process, testers were chosen with a smartphone that had different operating systems and manufacturers.
The test consisted of three consecutive parts:
- Participants were navigated through the application by following four use cases. For example, driving a certain distance by both their car and by public transportation or by foot.
- The testers had to give detailed feedback about their experience by answering ten open and closed questions.
- Each tester was asked to independently and exploratively search for bugs.
Results
During the test, any bugs discovered were categorized by the responsible Testbirds project manager according to their severity from “critical” to “minor”. There was only one bug with the highest severity “critical” and six more with the category “high”. Most of the bugs were error functions. For example, journeys that either didn’t track at all or were displayed twice.
Overall, the test showed how advanced the Generali app was before the test started. In particular, the smooth registration process and reliable connection during tracking.
The impact on battery power was classified as low by most of the test participants while usability received very positive feedback.
After analyzing the detailed feedback, Testbirds provided recommendations to help raise the application’s quality level even further before its launch.
Structured Bug Testing
Make sure the core functions of your digital product are bug-free. Let the Crowd test it step-by-step according to detailed use cases.
Find out more
We provide you with the latest insights from the world of crowdtesting
Stop guessing if your product meets your users' expectations and start making decisions based on facts.
