Exploratory Bug Testing
Take your functional testing into the real world with Exploratory Bug Testing. Our crowd testers will explore your applications, hunt down all bugs, malfunctions & compatibility issues with their own devices.
Exploratory Bug Testing – Your advantages
A crowd of over 400,000 registered testers with over 900,000 devices
Support with the test design and the evaluation of test results
Custom test design – Together with you, we define the method of reporting bugs
Ad-hoc availability of our crowd
Live tracking and export bug lists using JIRA, Redmine and CSV capabilities
Take the quality of your applications to the next level!
The challenge: How can I ensure the functionality of my software on all the different devices in the market?
Continuously testing software on all of the latest devices, operating systems and browser versions requires an enormous amount of resources. Despite a strict time schedule, performing flexible yet extensive tests and identifying errors that have been missed during the internal quality assurance process is crucial. However, access to a group of testers with all the devices necessary, who are able to perform a test under real world conditions, is bound to amount in high costs and take a lot of time.
The solution: The crowd tests your software on their own devices
With our crowdtesting service Exploratory Bug Testing your software is tested along side user stories and predefined tasks. Still allowing our crowd testers to maintain the freedom to complete each step in their own way.
This process of functional testing in the real world helps discover the bugs that lead to the most common errors as well as special bugs that might not be covered by user stories. Every detail of the testing process is documented by our crowd and forwarded to your development team and their bugtracking solution (e.g. JIRA).
Our crowd features over 900,000 devices with a never-ending combination of operating systems and software versions. All this devices are accessible via our testing platform NEST, so device fragmentation or limits of an internal device farm is a thing of the past.
Exploratory Bug tests provide you with invaluable functionality feedback concerning your digital product from the point of view of your end user. With exploratory crowdtesting, operational blindness is a thing of the past. Bring your software development now to the next level by outsourcing your quality asssurance to the crowd.
How e-retailer OTTO optimises its webshops through crowdtesting
“By crowdtesting on the right devices with the right browser versions and operating systems, Testbirds helps us deliver more customer-friendly websites and keep them customer-friendly (…) We have a continuous process of change, adjustment and improvement. Testbirds offer their testing solutions with the same flexibility and agility, which made us decide to embed their testing services continuously into our development cycle.”
Corny van de Wal, Team Manager Shop Development & Production
How Landal GreenParks uses testing to optimise the guest experience
“Working with Testbirds led to us professionalising our testing process, as it forced us to critically examine our own testing structure. It definitely made our organisation more mature in that respect. Furthermore, crowdtesting has proven to be efficient. We can start testing on a Monday and see the results on Tuesday. It’s a powerful addition to our development process.”
Lieven Swinnen, Manager e-Business, Landal GreenParks
ACE Auto Club Europe puts their app to the test
“Testbirds is an excellent service provider and will continue to be our first point of contact when it comes to quality assurance”
Manuela Stauch, Digital Marketing, Auto Club Europe
Three Bug Tests for High-class Media Centres
“The tester feedback was very useful for us. They discovered indeed a few critical bugs. But it’s always better the testers encounter the bugs, and not the end-users.(…) We could export the bug list from the platform very easily and pass it on to our developers. That way we know exactly when and on which devices the bugs occurred”
Urszula Styrczula, Customer Care Manager at nexx.tv
How Exploratory Bugtesting looks in practice
The appstore rating of one of your applications is much worse in the Google Play store than in the Apple Store due to a number of bad reviews about bugs. We start a test using a tester group of 25 Android users from our crowd, each operating Android 4.0 to 6.0 devices. After only a few days, the final test report yields 59 bugs. They can all be reproduced on our platform, or “Nest”, with the help of Virtual Machines. Most of them are easily fixed, such as faulty hyperlinks or images, but there are also seven severe bugs that lead to the application crashing. By fixing those errors, the app is successfully optimized for Android devices, raising the Google Play store rating.
Full flexibility for smaller teams and SMBs
(equals 50 BC*)
Selection Tester: Client
Test Design: Client
Selection criteria testers: 14
Criteria available per test: 4
Test setup and tester management: Client
Test Evaluation and Analysis: Client
Access to Self Service Portal
Payment: Creditcard + Paypal
Premium service & support for Enterprise clients
(equals 100 BC*)
Selection Tester: Testbirds
Test Design: Testbirds
Selection criteria testers: 65 / on demand
Criteria available per test: unlimited
Test setup and tester management: Testbirds
Test Evaluation and Analysis: Testbirds
Access to Self Service Portal
Full Premium Support (Telephone & Onsite)
Invoicing: Customized to your needs
Dedicated Account & Customer Success Manager
Dedicated Senior QA/UX Consultant
Customized test results with bug reporting
*The basis of Testbirds’ pricing model is its own currency, BirdCoins, which form a flexible subscription model that allows for full QA and UX test coverage. Once purchased, you can invest in over 20 different crowdtesting solutions across a variety of service levels, such as purely using our platform to a fully managed testing process with a dedicated, expert project manager. The minimum tester setup of 10 testers references the lowest amount possible, normally we recommend integrating more testers to increase the significance and amount of data that is generated. 40 testers is a representative example for pricing purposes, but absolutely not an upper limit. The recommended number of testers heavily depends upon the requirements of your digital products. If you need further assistance, simply get in touch with us.
Solution Consultant QA & UX
Do you have questions about Exploratory Bugtesting? Would you like to have more information on how we can help you make your digital products even better? Just send us a message, one of our Solution Consultants will be happy to get in touch with you.
Innovative App & Web Testing
Watch our masterclass video series on QA & UX Testing - as seen on The Telegraph & Business Reporter. Discover with our CEO & host Philipp Benkler how to optimize your digital products in the best way possible.