Exploratory Bug Testing
Get real insights into the behaviour of your target group. Let our Crowd check your digital product for bugs you never expected to find.
ADVANTAGES OF EXPLORATORY BUG TESTING
Let experienced testers freely check your digital product for bugs
Get real insights from real end-users – eliminating operational blindness
Make your product bug-free on every device, screen resolution, software, and OS
Live-track and export all bugs directly in your bug-tracking software (e.g. JIRA or Redmine)
Leverage Exploratory Bug Testing to bring the quality of your digital products to the next level!
What is Exploratory Bug Testing?
The term exploratory testing was first introduced in 1986 and is defined as “a style of software testing that emphasizes the personal freedom and responsibility of the individual tester to continually optimize the quality of his/her work by treating test-related learning, test design, test execution, and test result interpretation as mutually supportive activities that run in parallel throughout the project.”
So, what does that actually mean? An exploratory bug test lets testers look for bugs freely and creatively. There is no test script, no rigid plan – testers have personal freedom which means this kind of bug testing places a lot of responsibility with the testers. During the test, testers learn and iterate constantly, and find their own way to solve problems that may occur. Testers can always optimize their test run – the more experienced and creative a tester is, the more bugs he or she will find.
As the name suggests, an exploratory bug test is a functional test that encourages real-time and practical thinking of the tester. Testers decide their next steps on-the-fly and continuously adapt them as they move deeper into the software of your digital product.
The difference between an exploratory and structured bug test
When performing an exploratory bug test, the testers have a lot of freedom in how they conduct the test – but also more responsibility. Exploratory testing focuses on testing as a “thinking” activity, so it is much more customer-centric than structured tests.
Structured testing follows a test script with different cases that include expected outcomes. Testers get pre-defined test cases and are only the ones who execute them. Structured testing leaves no room for tester creativity or looking through the software on their own.
Advantages of Exploratory Testing
Exploratory bug tests are capable of finding bugs in places that might not be obvious, as opposed to structured bug tests that are made for finding bugs in core areas of your product like the checkout process or in the behaviour of a contact sheet.
As testers move freely through your digital product they will use it from a real customer perspective and may find bugs you would never have thought existed. Therefore it is very important to have testers that match your exact target group and who are experienced in software testing.
The challenge: operational blindness and fragmented device landscape
You are done with your internal quality assurance (QA) but still wonder if you might have missed an important software bug or other malfunctions? Operational blindness is a big issue here, as your users will always use your digital product differently than your developers or even your staff from other departments. So you need a way to get insights on how your target group will use your product – because customer-centricity gets more and more important during these days.
Another challenge for you might be the continuously growing device landscape. Testing software on all of the latest devices, operating systems and browser versions requires an enormous amount of test planning, resources and investment. Despite strict timelines, performing flexible & extensive tests are necessary to provide your users with the best digital experience possible.
The solution: Exploratory Bug Testing of your software in the real world
Crowdtesting makes the difference: by using the power of over 400,000 digital testing experts and the variety of over 900,000 devices directly at their fingertips. This approach helps you save costs, transfers your testing into the real world – with real-world conditions & influencing factors. Crowdtesting gives you the freedom to scale whenever you want and need to.
With our service, Exploratory Bug Testing, we give our Crowdtesters the freedom to complete each step in their own way. This process of functional testing in the real world helps discover the bugs that lead to the most common errors as well as special bugs that might not be covered by user stories or test cases.
Every detail of the testing process is documented by our Crowd and forwarded to your development team and their bug tracking solution (e.g. JIRA & Redmine). So bug fixes can already start while the test is still running – paving the way to a bug-free digital product. With our QA Testing add-ons Re-Test & Bug Approval, you can integrate our Crowd easily into your regression testing, integration testing and continuous optimization processes. So, it’s also a perfect fit for all agile environments.
Our crowd features over 900,000 devices with a never-ending combination of operating systems and software versions. All these devices are accessible via our testing platform NEST, so device fragmentation or limits of an internal device farm is a thing of the past. Exploratory bug tests provide you with invaluable functionality feedback for your digital product from the point of view of your end-user. With exploratory testing, operational blindness is a thing of the past. Bring your software development to the next level, now, by outsourcing your quality assurance to the Crowd.
How e-retailer OTTO optimises its webshops through crowdtesting
“By crowdtesting on the right devices with the right browser versions and operating systems, Testbirds helps us deliver more customer-friendly websites and keep them customer-friendly (…) We have a continuous process of change, adjustment and improvement. Testbirds offer their testing solutions with the same flexibility and agility, which made us decide to embed their testing services continuously into our development cycle.”
Corny van de Wal, Team Manager Shop Development & Production
How Landal GreenParks uses testing to optimise the guest experience
“Working with Testbirds led to us professionalising our testing process, as it forced us to critically examine our own testing structure. It definitely made our organisation more mature in that respect. Furthermore, crowdtesting has proven to be efficient. We can start testing on a Monday and see the results on Tuesday. It’s a powerful addition to our development process.”
Lieven Swinnen, Manager e-Business, Landal GreenParks
ACE Auto Club Europe puts their app to the test
“Testbirds is an excellent service provider and will continue to be our first point of contact when it comes to quality assurance”
Manuela Stauch, Digital Marketing, Auto Club Europe
Three Bug Tests for High-class Media Centres
“The tester feedback was very useful for us. They discovered indeed a few critical bugs. But it’s always better the testers encounter the bugs, and not the end-users.(…) We could export the bug list from the platform very easily and pass it on to our developers. That way we know exactly when and on which devices the bugs occurred”
Urszula Styrczula, Customer Care Manager at nexx.tv
Full flexibility for smaller teams and SMBs
(equals 50 BC*)
Selection Tester: Client
Test Design: Client
Selection criteria testers: 14
Criteria available per test: 4
Test setup and tester management: Client
Test Evaluation and Analysis: Client
Access to Self Service Portal
Payment: Creditcard + Paypal
Premium service & support for Enterprise clients
(equals 100 BC*)
Selection Tester: Testbirds
Test Design: Testbirds
Selection criteria testers: 65 / on demand
Criteria available per test: unlimited
Test setup and tester management: Testbirds
Test Evaluation and Analysis: Testbirds
Access to Self Service Portal
Full Premium Support (Telephone & Onsite)
Invoicing: Customized to your needs
Dedicated Account & Customer Success Manager
Dedicated Senior QA/UX Consultant
Customized test results with bug reporting
*The basis of Testbirds’ pricing model is its own currency, BirdCoins, which form a flexible subscription model that allows for full QA and UX test coverage. Once purchased, you can invest in over 20 different crowdtesting solutions across a variety of service levels, such as purely using our platform to a fully managed testing process with a dedicated, expert project manager. The minimum tester setup of 10 testers references the lowest amount possible, normally we recommend integrating more testers to increase the significance and amount of data that is generated. 40 testers is a representative example for pricing purposes, but absolutely not an upper limit. The recommended number of testers heavily depends upon the requirements of your digital products. If you need further assistance, simply get in touch with us.
Solution Consultant QA & UX
Do you have questions about Exploratory Bugtesting? Would you like to have more information on how we can help you make your digital products even better? Just send us a message, one of our Solution Consultants will be happy to get in touch with you.
Adding the Human Factor: Crowdtesting in Agile Development
Agile development cycles need fast, flexible testing while also taking the human factor into account. Join now the discussion with Deutsche Telekom AG and Testbirds.