Select Page

Have you ever wondered how we select testers for our tests?

by | Jan 4, 2018 | QA, Crowdtesting, Testing Reality, Usability & User Experience | 0 comments

At Testbirds, our clients request many different types of end users to test their applications and websites. We take these challenges very seriously and always provide the best possible solution for each test. Our Nest is the central platform for all clients, testers and project managers. But how does the selection process actually work?

An example when selecting testers for a test might be as follows.

Exploratory Bug Testing

  • Bug test of a shopping app
  • iOS and Android
  • 30 testers

In this case, it is a functional test, where the testers look for bugs in the app. Here the selection of devices and testers is crucial to the test result. Since Android itself has such a large diversity of its own operating system and the devices it runs on, the test needs to cover a variety of them, usually the most common ones including a couple more exotic devices. The project manager who’s responsible for the project then goes on to our testing platform Nest and filters our crowd for the specific target group.

  • Users with iOS (e.g. 10.x) and Android (e.g. Android 6.x – 8.x) devices
  • Mix of normal users as well as testers that are more experienced. The reason being that normal users tend to find issues that professionals don’t and vice versa.
  • Completed the entry test
  • Speak german fluently (since it’s a German app)

The project manager has to find the number of requested testers in order to carry out the test. Once the constraints are put in the Nest – Testbirds platform for testing – to filter the crowd for the specific target group, the invites are sent out systematically to testers who fulfil the constraints until we have the required amount of testers signed up. There is also a small number of testers in the waiting list (queue) as a backup, in case testers drop out. Relying on our crowd to finish a test is crucial for us, since we depend on the exact amount of reports being submitted. Imagine a test for which we need 20 different devices. If one tester drops out, we have to find somebody else with the exact same device and operating system in a very short amount of time.

Usability and UX Study

  • Usability test of a global company’s career application website
  • Desktop devices, tablets & smartphones
  • Special target group: consumers, partners, investors, journalists, job seekers
  • 160 testers: 5 different countries – Testbirds testers + client testers
  • Bring Your Own Crowd – client uses some of their own employees to test

For usability tests with a very specific target group, gathering the required testers is even trickier. Although we can filter our crowd on more than 60 different types of demographics, the more constraints you need to find a specific tester the harder it gets, since not all testers fill their profiles completely and update them with new things like their job or interest in finance. They also need to have the time and be available to do the tests. In the above (quite complex) example, the client wanted to bring some of their own crowd, i.e. their own employees to test the application. Bring Your Own Crowd (BYOC) is a concept we offer to include a clients’ employees in testing enterprise applications.
If we cannot filter all criteria through the tester profiles, a pre-questionnaire helps to identify relevant testers. This is an option we use to make sure the selected crowd matches the requested target group. If testers have not filled out their profiles to an extent, they will be screened out from the start, which means we have to recruit more. Selecting very specific target groups for a test can be difficult even with a large crowd like ours.

Of course, not all projects require such specific criteria. But if they do, it’s very valuable to know a lot about our crowd and be able to rely on them for testing.

Share it if you like it:

Tag Cloud

About the author

Nilani Shan

Nilani Shan

Business Development Intern UK

Categories

Links

Other content that might be interesting for you:

Testbirds wins Deloitte Technology Fast 50 Award

We are proud to call ourselves winners of the Technology Fast 50 Award by Deloitte, as one of the fastest growing Tech-Scale-Ups! We already knew...

How We Became a FOCUS Revenue Growth Champion: A Brief Company History

Testbirds is “FOCUS Wachstumschampion 2018”, which means we are one of 500 companies with the highest revenue growth in Germany! The German news...

Meet our End-to-End Testers: Dominik and Doris

What is end-to-end testing? In this edition of the "Meet our Testers" blog posts, we will introduce two testers who recently participated in an...

I’m Ferdi and This is My Role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

Our Top Testers talk Crowdworking with IG Metall

In February, 14 of our Top Testers from across Germany joined Testbirds and IG Metall (a German Worker’s Union) to start a dialogue about fair crowd...

11 Tips on looking for bugs

Have you ever wondered how to find bugs effectively? Do you have your own set of test cases when looking for issues? In this post we will provide...

“I Want to Improve Software” – Why Birds Test

Every day, thousands of birds play in our nest and thoroughly test apps and websites. But what motivates them to find bugs and give usability...

New Blog!

Today is St Nicholas' Day - the perfect occasion to start our new blog!Christmas season seems to be ideal for us to update. Around this time last...

Nest Testing Platform – Interviews with our crowdtesters

This post is the third of our The Nest Landing page series and this week we’re talking to two testers who took part in the Bugability™ test on our...

I’m Christine and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact