Select Page

Webinar Recap | Make Motorbike Enthusiasts into a Worldwide Tester Community

May 8, 2020 | Webinars, Internet of Things, Usability & User Experience, Automotive & Connected cars

Together with our partner BMW Motorrad, we look at a very successful testing past, present, and future. In one particular project we faced a lot of challenges, learning a lot from tackling them together, and improving our team coordination when it comes to testing IoT products from the automotive industry.

In our webinar last week, we talked about crowdtesting the BMW Motorrad Connected App and the challenges in developing digital IoT apps that support BMW motorcycles. We also discussed the benefits of Crowdtesting and tailor-made solutions like Bring-Your-Own-CrowdTM. If you weren’t able to join or would like to revisit some of the key points, here’s a recap from our webinar “Riding the Digitalization Highway in the Automotive Industry”.

The Non-Digital World of Motorbikers

Jann Kirchhoff, one of the speakers last week, is Product Owner of Connected Ride Apps & Digital Services at BMW Motorrad. In the development process for digital products, he represents the voice of the user community.
Jann started the webinar by painting the picture of what motorbiking is all about. It’s about being outside, racing, touring, sometimes being together on one bike for thousands of kilometers, or riding the entire weekend just for the pure joy of being on the road. The route is the destination. It’s an analog, dirty, and sometimes pretty isolated world, where digital features or wifi connections are not needed most of the time, or not even available.

BMW Motorrad started implementing digital features into this world in 2017. They introduced a TFT display, equipped with a multimedia controller. With this and a Bluetooth-compatible helmet, riders can connect their smartphone with their bike and the headset inside their helmet, enabling them to take phone calls or control their music through the display.
Additionally, BMW Motorrad launched the Connected App that allowed even more advanced functionalities like navigation, road tracking, vehicle information, etc. All of this needed to be designed in a way that doesn’t limit the riders fun, but rather further enhances the joy of being on the open road.

Getting Digital – Setting Up Testing Processes

In order to test the new app, BMW needed to overcome the limits of testing in a lab. Putting the customer first, they wanted to bring testing to the streets and get the opinions of their real customers and see how the app behaves in real-world conditions.

Testbirds came in to support BMW with its testing expertise. The only problem was that back in 2018 there were nearly no motorcyclists in the Testbirds Crowd, let alone motorbike enthusiasts, that had BMW bikes with the newest TFT display.  In the webinar this was the cue for Jan Bode, International Community & Crowd Manager at Testbirds. He walked the webinar participants through the path of how he and BMW built up a whole new testing community – with only BMW Motorrad riders and pure motorbike fans.

How We Made Motorbike Enthusiasts Into a Worldwide Tester Community

The first step was to get in touch with BMW motorcyclists. Being motorbike enthusiasts themselves, the employees at BMW knew where to find them and pointed Jan in the direction of a Facebook community and a few motorbike clubs. There were many suitable testers, but also many challenges to overcome:

1)  Trust
Many people have, unfortunately, not yet heard of a Crowdtesting company called Testbirds. And why would a motorbike rider (or anyone else) trust a company they’ve never heard of?
To build up trust with the new tester community, we worked closely together with Jann Kirchhoff from BMW Motorrad. He created explanatory videos, talking about BMW’s point of view and the importance of authentic testing processes, carried out with real users. Building trust was also helped by the possibilities of the Testbirds Exclusives solution Bring Your Own CrowdTM. It allows you to create a customized platform, with your own look & feel and a separate, dedicated tester community.
This way, when registering as a tester, the participants aren’t entering an unknown world, but a BMW Motorrad world where they feel comfortable and at home.

2)  Weather conditions
The first test runs with the newly recruited tester community went really well, mainly consisting of European bikers. Before long, this had to be expanded to a global and international level, especially when a new beta version of the Connected App needed to be tested – and it was snowy all over Europe.
Jan, from the Testbirds Crowd team, started to recruit new testers from motorbike clubs all over the world. Now, we have 250 BMW Motorrad testers worldwide, in more than 30 countries, that test in all weather conditions. If it’s winter here, for example, our testers in Australia can test and ride their BMW bikes along the Sunshine Coast.

3)  Different levels of technical comprehension
The average age of testers in the Testbirds Crowd is under 30. The average age of testers for BMW cars is 37. The average age of testers for BMW Motorrad is 48. In line with the traditionally analog nature of motorbiking, many testers in the dedicated BMW Motorrad tester community found that it wasn’t easy to tackle all the different test cases and tasks in the beginning. Therefore, we created a custom onboarding process for this dedicated tester group, including testing guidelines and special assistance for troubleshooting.

Continuously Bringing the Product to the Next Level

Today, Crowdtesting is a fully integrated test process in BMW Motorrad’s development cycles. With end-to-end tests, remote interviews and the Bring-Your-Own-CrowdTM concept, BMW creates digital products that their customers are really enthusiastic about and gets the most honest feedback possible – from their most important customers.
Sören Sdun, Customer Success Manager at Testbirds, phrased it like this in the webinar, “All of the riders that are testing for BMW are not on this testing journey for the money. They are involved emotionally and want to participate in the process of building better motorbikes – together.”

Sometimes, testing can happen very fast. Jann Kirchhoff ended the webinar with an anecdote of one extremely fast test cycle with Testbirds.
Back then, Jann told his contact at Testbirds about a new version of the BMW Connected App on a Thursday evening. Testbirds recommended an
end-to-end test, set up the test case on Friday and informed the testers. The testers were excited to go out for a ride on the weekend and BMW Motorrad received the full test results on Monday.
Thanks to our enthusiastic testers we were able to conduct a rapid test suitable for speed freaks

Do you want to know more about this topic?

We’ve got you covered. You can watch the full webinar below. You can also find out more about how BMW Motorrad and Testbirds align app distribution and quick iterations with the long-term product life cycle of motorbikes.


If you still have questions, feedback, or similar testing ideas, feel free to contact Fabian Goldstein, our Senior Account Manager Automotive at Testbirds.

Fabian Goldstein

We’d also like to thank Jann Kirchhoff and BMW Motorrad for the great, ongoing partnership and the very successful webinar last week.

Share it if you like it:

Tag Cloud

About the author

Regina Heiß

Regina Heiß

PR & Marketing Manager

Birds flying high, you know how I feel… whenever Regina is not working in the marketing-team for Testbirds, you can find her singing with her Jazz-Trio .



Other content that might be interesting for you:

Brace yourself, because winter is coming!

When you wake up and it's still dark out, when your ride to work is surrounded by foggy subway windows, when you put away your summer shorts full of...

Challenges for today’s work environment

...and how we as an employer can contribute to the betterment of society From my perspective, the biggest challenges for today’s work environment...

Achieving a Seamless User Experience Through Testing

It's no secret that the digital world is highly competitive today. The only way to have a chance at success in this over saturated marketplace is if...

#Almedalen: Where politics, media and startups come together

“Almedalsveckan” (Almedalen Week). An 8-day political event in Gotland, Sweden that attracts 40 000 visitors. This is where all of Sweden’s most...

Testing with Testbirds: From Fantasy Football Tips to Fantasy Football Superstar

Oscar Wilde once said, “A dreamer is one who can only find his way by moonlight, and his punishment is that he sees the dawn before the rest of the...

Testing in the cloud versus real-life testing – two sides of the same coin

When it comes to software testing, innovation is key. It’s hard to keep up with all kinds of trends popping up like mushrooms, and to keep an...

Decision-making processes at Testbirds: “Nobody alone is as smart as we are together.”

These nine words by Laloux pretty much sum up what Testbirds stands for and how we work. On the one hand, of course, our service: crowdtesting can...

Testbirds Presents: Women in IT – Ada Lovelace

International Women's Day Every year on March 8th, International Women’s Day is celebrated. This initiative is supported by many charities,...

5 things learned from opening a Swedish office

Finally the bird has landed in Sweden! In Hornstull, Stockholm to be exact. My name is Jonna Knibestöl and I joined Testbirds as a part of the...

Our Top Testers talk Crowdworking with IG Metall

In February, 14 of our Top Testers from across Germany joined Testbirds and IG Metall (a German Worker’s Union) to start a dialogue about fair crowd...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact