5 Tips for Successful Crowdtests

by | Nov 25, 2019 | QA, Crowdtesting, Usability & User Experience | 0 comments

Here it is, the last part of our masterclass in partnership with Business Reporter. Today, Philipp Benkler, CEO and Co-Founder of Testbirds, talks about our core service – Crowdtesting – and why we believe it’s THE way to go, following our mission to create digital products people truly love.

Crowdtesting means testing with an online community. It helps you test and optimize the user-friendliness, usability, and functionality of your digital products in real-world conditions.

Get a first glimpse of the video here:

At Testbirds, anyone can become a member of the Crowd – no matter whether they have testing experience, or not. Once they’re a member of the Crowd they get invitations for QA and UX tests and are asked to look for defects and usability problems on their own device.
Depending on what kind of test it is, we’re either looking for testing experts with a lot of experience, or for real end-users – or both.

For most quality assurance tests we need a good mix between experienced testing experts and “normal” end-users. Experienced testers will find bugs and problems reliably and in almost no time at all. But on the other hand, real users often have a different approach and way of using a product, so they will most likely find different bugs than the testing experts.

For usability and user experience tests, it’s very important to find the right representatives of the customer’s target group. You want to get feedback from your exact target group because it doesn’t make sense to let IT specialists check an app that’s made for young parents or pet owners.
Let me give you some tips for conducting successful Crowdtests in the following paragraphs.

Crowdtesting – How to best perform it

Before you’re ready to start your first Crowdtest, there are some things you should keep in mind before, during, and after the test.

1. Responsibility

It’s a must that Crowdtesting is embedded into the overall strategy, in a way that works on an individual basis. When working with a Crowd, it’s vital that tasks are clearly outlined and that crowdsourced workers have a strong grasp of the responsibilities that are expected of them.
This is especially true due to the fact that the Crowd is often located internationally and communicated with remotely. Similarly, it’s important that the entire process is well-organized and thought through in detail, before testing begins. Who oversees the testers and who creates the test design? Who implements the results of the testing process and responds to questions in case the software doesn’t work after fixes are applied?

2. Preparation

Planning is an absolute must – no matter what testing method is used. With crowdsourced testing it’s especially important as testers work remotely. This means that they are unable to receive feedback immediately and communication as a whole doesn’t take place instantaneously.
Before testing it’s important that the goal is kept in mind, questionnaires with detailed instructions on what to do are designed, and the steps that will guide testers through the process are well defined. It’s important that the people designing the test try to visualize the problems that might arise or aspects that might be unclear to testers when setting the test up.
If you want to learn more about creating test scripts read our blog post “Successful UX Tests: How to Write a Test Script

3. Tester Training

It’s vital to train people appropriately and make them aware of the requirements. It’s equally important to show them how best to use the platform. Entry tests ensure that testers know how to handle their devices and the testing platform, which in turn will yield results of a higher quality. Tutorials and videos that show how the platform works and how to report bugs can ensure that testers are well-prepared to handle the responsibilities expected of them.

4. Tester Selection

To select the right people for a test, you need as much information about them as possible. For usability testing, people that represent the target group for the product is a must – in the end, they will be the customers actually using and reviewing the product.
For functionality testing, this isn’t as big of an issue, instead, it’s important that testers are experienced and have the necessary devices.
Want to learn more about tester selection and defining your target group? Then read our blog post “UX Testing – User-Based Testing

5. Motivation

Happy testers are good testers. Therefore, it’s beneficial to provide adequate incentives and motivating tasks. Other than fair payment, a reward system can also be used to motivate people, based on the quality of the bug reports, for example, or gamification of the testing process. Additional payment for bugs found when performing a test can lead to an increase in creativity and engagement when hunting for bugs.

Giving experience points for test participation helps qualify testers and can also serve as motivation for the testers themselves. Tester rankings and awards for extraordinary achievements can also be used to further motivate the Crowd.

As all good things must come to an end, this was the last part of our masterclass series with Business Reporter. We hope you’ve gathered good insights into QA-, UX- and Crowdtesting, and now understand why we really need innovative testing methods.
For those of you who missed previous blog articles, here’s an overview:

Part 1: Why We Need Innovative Testing Methods
Part 2: What is QA Testing and Why Do We Need It?
Part 3: 5 Steps to Successful QA Tests
Part 4: UX Testing – User-Based Testing

Share it if you like it:

Tag Cloud

About the author

Simone Groß

Simone Groß

Content Marketing Manager

When Simone is not working on superb texts for Testbirds, she and her horse live it up on the tournament areas in Bavaria.



Rate this post

5 Tips for Successful Crowdtests
5 (100%) 1 vote

Other content that might be interesting for you:

Anti-Virus Software for your smartphone – Do you use it?

Remember the time we actually went and purchased a CD with Anti-Virus Software from our PC Reseller? They were not that cheap, but it had to be...

Client Wiesn 2019: Bugs, Bier & Brezn

You know, being a Munich-based company can be really tough - especially during the two weeks at the end of September and beginning of October. Why?...

Software failure leads to economic damage

Recently, a national survey has been conducted in the Netherlands that sheds light on the economic impact of software failure. The results are...

Crowdworking – Die Zukunft der Arbeit?!

Wie verändert die Digitalisierung unsere Arbeitswelt? Ersetzen uns zukünftig Maschinen? Hat der klassische Arbeitsplatz, wie wir ihn bislang...

Testbirds Holiday Apps: Halloween

In the midst of Autumn, characterized by dead leaves that stain a cold ground an auburn hue and naked branches which caress your periphery vision,...

Flexible working: It’s not about where you are, but what you do

It's all about trust In many companies, the following mind-set is still quite common: Flexible working (e.g. home office) means having no control...

Like a group of friends: How to make smart decisions in a growing company

How are the best decisions made? Today, I’d like to share some insights about decision-making. At Testbirds, this is the first of our four...

I’m Nikolay and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

Apple does it again: How the tech gigant is revolutionising our behaviour

On Tuesday, Apple was once again holding its annual developer conference WWDC and presented its latest innovations. Two weeks ago, we reported on...

U, UX, UI … OMG?!

Working at Testbirds for several months now, I have to admit: you really become sensitive towards certain topics. The misuse of terms and buzzwords,...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact