5 Tips for Successful Crowdtests

by | Nov 25, 2019 | QA, Crowdtesting, Usability & User Experience | 0 comments

Here it is, the last part of our masterclass in partnership with Business Reporter. Today, Philipp Benkler, CEO and Co-Founder of Testbirds, talks about our core service – Crowdtesting – and why we believe it’s THE way to go, following our mission to create digital products people truly love.

Crowdtesting means testing with an online community. It helps you test and optimize the user-friendliness, usability, and functionality of your digital products in real-world conditions.

Get a first glimpse of the video here:

At Testbirds, anyone can become a member of the Crowd – no matter whether they have testing experience, or not. Once they’re a member of the Crowd they get invitations for QA and UX tests and are asked to look for defects and usability problems on their own device.
Depending on what kind of test it is, we’re either looking for testing experts with a lot of experience, or for real end-users – or both.

For most quality assurance tests we need a good mix between experienced testing experts and “normal” end-users. Experienced testers will find bugs and problems reliably and in almost no time at all. But on the other hand, real users often have a different approach and way of using a product, so they will most likely find different bugs than the testing experts.

For usability and user experience tests, it’s very important to find the right representatives of the customer’s target group. You want to get feedback from your exact target group because it doesn’t make sense to let IT specialists check an app that’s made for young parents or pet owners.
Let me give you some tips for conducting successful Crowdtests in the following paragraphs.

Crowdtesting – How to best perform it

Before you’re ready to start your first Crowdtest, there are some things you should keep in mind before, during, and after the test.

1. Responsibility

It’s a must that Crowdtesting is embedded into the overall strategy, in a way that works on an individual basis. When working with a Crowd, it’s vital that tasks are clearly outlined and that crowdsourced workers have a strong grasp of the responsibilities that are expected of them.
This is especially true due to the fact that the Crowd is often located internationally and communicated with remotely. Similarly, it’s important that the entire process is well-organized and thought through in detail, before testing begins. Who oversees the testers and who creates the test design? Who implements the results of the testing process and responds to questions in case the software doesn’t work after fixes are applied?

2. Preparation

Planning is an absolute must – no matter what testing method is used. With crowdsourced testing it’s especially important as testers work remotely. This means that they are unable to receive feedback immediately and communication as a whole doesn’t take place instantaneously.
Before testing it’s important that the goal is kept in mind, questionnaires with detailed instructions on what to do are designed, and the steps that will guide testers through the process are well defined. It’s important that the people designing the test try to visualize the problems that might arise or aspects that might be unclear to testers when setting the test up.
If you want to learn more about creating test scripts read our blog post “Successful UX Tests: How to Write a Test Script

3. Tester Training

It’s vital to train people appropriately and make them aware of the requirements. It’s equally important to show them how best to use the platform. Entry tests ensure that testers know how to handle their devices and the testing platform, which in turn will yield results of a higher quality. Tutorials and videos that show how the platform works and how to report bugs can ensure that testers are well-prepared to handle the responsibilities expected of them.

4. Tester Selection

To select the right people for a test, you need as much information about them as possible. For usability testing, people that represent the target group for the product is a must – in the end, they will be the customers actually using and reviewing the product.
For functionality testing, this isn’t as big of an issue, instead, it’s important that testers are experienced and have the necessary devices.
Want to learn more about tester selection and defining your target group? Then read our blog post “UX Testing – User-Based Testing

5. Motivation

Happy testers are good testers. Therefore, it’s beneficial to provide adequate incentives and motivating tasks. Other than fair payment, a reward system can also be used to motivate people, based on the quality of the bug reports, for example, or gamification of the testing process. Additional payment for bugs found when performing a test can lead to an increase in creativity and engagement when hunting for bugs.

Giving experience points for test participation helps qualify testers and can also serve as motivation for the testers themselves. Tester rankings and awards for extraordinary achievements can also be used to further motivate the Crowd.

As all good things must come to an end, this was the last part of our masterclass series with Business Reporter. We hope you’ve gathered good insights into QA-, UX- and Crowdtesting, and now understand why we really need innovative testing methods.
For those of you who missed previous blog articles, here’s an overview:

Part 1: Why We Need Innovative Testing Methods
Part 2: What is QA Testing and Why Do We Need It?
Part 3: 5 Steps to Successful QA Tests
Part 4: UX Testing – User-Based Testing

Share it if you like it:

Tag Cloud

About the author

Simone Groß

Simone Groß

Content Marketing Manager

When Simone is not working on superb texts for Testbirds, she and her horse live it up on the tournament areas in Bavaria.



Rate this post

Other content that might be interesting for you:

New Blog!

Today is St Nicholas' Day - the perfect occasion to start our new blog!Christmas season seems to be ideal for us to update. Around this time last...

The Testbirds Party Bus is back in town!

MWC is one of the highlights for us at Testbirds every year. We love going there to network, to get updated about the upcoming mobile trends,...

UX Testing – User Based Testing

Today we want to turn the spotlight on another branch of testing, namely usability testing or user based testing, and especially the importance of...

Meet our Testbirds: Alexis

For this month’s tester story, we have invited Alexis from Belgium to share his Testbirds experience. He is one of the most experienced testers in...

I’m Marc-David and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

MWC Raffle – Hall of Fame

It might sound weird, but we cannot wait for Monday. On this day Mobile World Congress 2017 will start and we are very happy to be a part of it. As...

Webinar Recap | Make Motorbike Enthusiasts into a Worldwide Tester Community

Together with our partner BMW Motorrad, we look at a very successful testing past, present, and future. In one particular project we faced a lot of...

How to design a chatbot

As a user experience (UX) professional, visiting one of the great UX Monday after-work events has been on my agenda since I moved back from London...

Our step into the automotive world: Testbirds is partnering with….?

…the BMW Group! Today we are excited to announce a comprehensive contract. First, let me start at the very beginning. Our journey started with...

One week with my Shine

Last year, I bought myself a Sony Smartwach 2. Obviously, smartwatches haven’t been able to make a breakthrough yet, which is why I’m still getting...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact