Select Page

Our Case Studies

Learn more about how we helped our customers optimise their products with the help of our innovative testing services.

DEVICES/SOFTWARE

OS: Android, iOS
Software: ACE App

TESTERS

Number: 32
Age: 17-57 years
Nationality: DE
Skills: different experiences in quality assurance

TESTERS FOR REMOTE INTERVIEWS

Number: 5
Age: 20-60 years
Nationality: DE

ACE Auto Club Europe puts their app to the test

QUALITY ASSURANCE

Exploratory Bug Testing

USABILITY AND UX

Remote Interviews

The ACE Auto Club Europe (ACE) is the second largest automobile club in Germany with more than 630.000
members. In order to continuously improve its’ digital offer and meet the needs of its members and users, the ACE commissioned the Munichbased testing specialist Testbirds to test the ACE app for Android and iOS in several test runs, including the search for technical errors and limitations of usability. The testing began with an explorative bug test and was followed by a test run with Remote Interviews.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets & smartphones
Software: airline-holidays Website

TESTERS

Anzahl: 20
Alter: 19-53 Jahre

Z

ACHIEVEMENTS

Conversion-Rate-Optimization
Layout & Design Optimization

Continuous Testing with airline holidays

TESTBIRDS EXCLUSIVES

BugAbility™

Airline holidays is an online travel agency that offers a combination of flights, hotels, travel insurances,
and rental cars as package holidays. Because airline holidays’ daily business is one hundred percent based
on direct online sales, the company needs to make sure that their website works perfectly. To ensure this,
airline holidays professionally tests their website with Testbirds on a regular basis.
A testing concept that convinced the management board right away. André Kollmeyer, Managing Director of airline holidays, explains what characterizes the Testbirds concept: “The combination of large-scale crowdtests, small but excellent usability tests or the middle course, the so-called BugAbility study”.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Android, iOS
Software: Automotive App mit Chatbot

TESTERS

Number: 35
Nationality: DE / US
Net. Income: +100.000€
Skills:car owner, local dialects

Z

ACHIEVEMENTS

Optimisation of speech recognition, Bugfixing

The global crowd tests a chatbot for cars

TESTBIRDS EXCLUSIVES

Chatbot & Virtual Assistant Testing

TESTBIRDS EXCLUSIVES

BugAbility™

Together with a leading German car manufacturer, Arvato has now developed a solution concept for the digitization of the content of operations manuals. The special thing is that the information is not only available digitally in the form of an app, but can also be reproduced by a virtual assistant, a so-called chatbot, that communicates with the user. In order to find out if the chatbot fulfills the requirements of the target group, Arvato commissioned the Munich-based testing specialist Testbirds to thoroughly assess the chatbot

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

IoT: Camera, motion detector, two contact sensors
OS: Android, iOS
Software: ednet. home

TESTERS:

Number: 23
Age: 19-53
Gender: 85% ♂ / 15% ♀
Skills: interest in technology

A Secure Feeling: Smart Home Solution ednet by Assmann tested

TESTBIRDS EXCLUSIVES

End-to-End Testing

TESTBIRDS EXCLUSIVES

BugAbility™

TESTBIRDS EXCLUSIVES

End-to-End Testing

Always knowing if your home is secure is what ”ednet. smart home Starter Kit Security “ by Assmann Electronic does. The company conducted an End-to-End/BugAbility™ to optimise the smart home solution before the product launch. The test was conducted under real conditions in testers’ homes. For the study, 23 crowd testers from Testbirds searched for functionality and usability issues.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktop, Smartphone
OS: Windows & Mac, Android & iOS

TESTERS

Number: 21
Age: 20-59 years

Z

ACHIEVEMENTS

Comparison live site and prototype

Optimised visual representation of the products in the webshop

Improved customer satisfaction

Better Webshop with Beter Bed

USABILITY AND UX

Prototype Evaluation

USABILITY AND UX

Comparison Study

USABILITY AND UX

Card Sorting

Beter Bed and Testbirds work together on a regular basis, to make sure that Beter Bed’s digital platforms work like a dream. Recently, the menu structure of their prototype was compared to the existing website structure. Testers were also asked to give their opinions on a new part of the website dedicated to advice and inspiration.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Android, iOS
Software: BMW Motorrad Connected App

DEVICES

IoT: BMW R 1250 GS, BMW R 1200 GS (incl. Connectivity)

Z

ACHIEVEMENTS

Optimized customer experience
Creation of a dedicated tester community
Optimized real world cross-device testing

End-to-End Testing of BMW Motorrad‘s Connected App

TESTBIRDS EXCLUSIVES

End-to-End Testing

TESTBIRDS EXCLUSIVES

Bring-Your-Own-Crowd™

USABILITY AND UX

Remote Interviews

The BMW Motorrad Connected App opens a world of possibilities for its users when it comes to navigation, ride tracking and accessing vehicle data during and after a motorbike tour. The app connects to motorbikes via Bluetooth and shows the features on the motorcycle’s TFT-Display. Throughout this process, interaction between the app and motorcycle hardware is the biggest consideration.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Windows
Software: Celonis Process Mining

TESTERS

Number: 20
Age: 18-43
Gender: 70% ♂ / 30% ♀
Nationality: DE, USA, FR, NL
Skills: Finance, Controlling, IT

Swarm Intelligence for Development: Crowdtesting at Celonis

TESTBIRDS EXCLUSIVES

BugAbility™

Analysing and optimising business processes with artificial intelligence – that is what the
process mining software by Celonis does. The further development of the software platform focuses on high speed in terms of innovation as well as ensuring it runs without bugs and is user friendly. This motivated Celonis to perform a crowdtest with Testbirds. Previously,  the company only tested internally with their own employees. When doing this most enterprises face the issue of institutional blindness.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

IoT: ComfyLight Smart Bulb
OS: Android / iOS
Software: ComfyLight App

TESTERS

Number: 21
Gender: 61% ♂ / 38% ♀
Skills: 50% technically unskilled, 50% interested in technology

BUGS

Total Bugs: 42

Crowdtesting with the Internet-of-Things: Quality and usability put to the test

TESTBIRDS EXCLUSIVES

BugAbility™

TESTBIRDS EXCLUSIVES

End-to-End-Testing

An innovative home security solution that not only detects burglary, but actively protects your home – that’s ComfyLight, a smart light bulb. However, before the Internet of Things (IoT) application was ready for the market, it should be thoroughly tested. In the first test phase, the usability, user interface and comprehensibility of the first ComfyLight app were tested for both Android and iOS. The second phase included an End-to-End BugAbility™ study. The Android and iOS app was tested in combination with the intelligent light bulb.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Android, iOS
Software: Generali Mobility-App

TESTERS

Number: 27
Age: 20-59 years
Gender: 74% ♂ / 26% ♀
Nationality: DE, AT, CH
Skills: Software QA

The Crowd helps improving the Software: Testing the Generali Mobility App

QUALITY ASSURANCE

Structured Bug Testing

The test consisted of three consecutive parts: first, the participants got navigated through the key masks of the application by following four use cases. For example, driving a certain distance by both their car and by public transportation or by foot. In a second part the testers had to give detailed feedback about their experience by answering ten open and closed questions and in the final step they were asked to independently and exploratively search for bugs by themselves.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Android
Software: immowelt.de App

TESTERS

Number: 20
Age: 20-50 years
Gender: 74% ♂ / 26% ♀
Nationality: DE, AT, CH
Skills: Interested in real estate

immowelt.de optimiert seine mobile Android App mit Testbirds

USABILITY & UX

Usability & UX Study

Visitors of real estate portals such as immowelt.de are only two or three clicks away from the apartment of their dreams – but it is also only one click to get to another portal. If the user doesn‘t like the design, the interface is not sufficiently intuitive, or the presentation is not clear enough, it is highly likely that customers will change to another provider. Markus Teschner, Head of Product Management at Immowelt AG makes clear, “that high-quality
usability tests are crucial for customer loyalty.”

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

OS: Android, iOS
Software: interhyp App

TESTERS

Number: 20
Age: 30-50
Gender: 60% ♂ / 40% ♀
Nationality: DE
Skills: private property interest

Home loans in the digital age: Interhyp uses mobile app testing

USABILITY & UX

Remote Interviews

Making the dream of owning your own property come true is the business of Interhyp AG from Munich. To attend to their customers, the company offers an app among other services. With this app, clients get easy and transparent guidance for the process of applying for a home loan. It’s important that such an app is easy and comfortable to use. Testbirds offers clients the service of conducting remote interviews with crowd testers. With this service, companies can talk to a tester via video conference while they test the app. The tester can directly answer the client’s questions and give reasons why they would, for example, alter the design of an element.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets & smartphones
Software: webshop

TESTERS

Number: 148
Age: 30-50
Gender: 60% ♂ / 40% ♀
Nationality: NL

 

How Landal GreenParks uses testing to optimise the guest experience

 

QUALITY ASSURANCE

Load and Performance Testing

QUALITY ASSURANCE

Exploratory Bug Testing

USABILITY & UX

Usability and UX study

The outcomes of the tests have helped Landal avoid mistakes with its e-commerce platform and to develop new features that correspond with the wishes of its target audience. Some unexpected test results were also remarkably helpful. Swinnen adds: “In this way, we spot errors in a timely fashion, allowing us to avoid issues that have a negative impact on our conversion rate.”

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Smartphones & Tablets (Android, iOS), Desktop, Smart-TVs
Software: Multiscreen VOD platform „nexxCANVAS“

TESTERS

Number: 58
Age: 19–69
Gender: 81% ♂ / 19% ♀
Nationality: German
Target group: end users news magazine

nexx.tv: Three Bug Tests for High-class Media Centres

QUALITY ASSURANCE

Structured Bug Testing

QUALITY ASSURANCE

Exploratory Bug Testing

A quick and easy realization of video media centres – that’s what the nexx.tv GmbH offers with its multi-screen video-on-demand platform “nexxCANVAS”. The company developed a video media centre for a national German news magazine, which is available as a responsive website as well as apps for smartphones, tablets and smart TVs. To make sure that the media centre runs error-free on all relevant devices, nexx.tv conducted an Exploratory Bug Test with Testbirds. “For us it was very important that the media centre is tested on as many devices as possible to offer the end-users a first-class video experience”, says Urszula Styrczula, Customer Care Manager at nexx.tv.“

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets and smartphones
Software: Webshop

TESTERS

Number: 116
Nationality: NL

BUGS

Total Bugs: 249
Critical: 2
High Prio: 35
Medium Prio: 98
Low Prio: 114

How e-retailer OTTO optimises its webshops through crowdtesting

QUALITY ASSURANCE

Exploratory Bug Testing

TESTBIRDS EXCLUSIVES

BugAbility™

Otto BV is one of the largest companies within the internationally operating Otto Group, an established organisation with a long history in home shopping. OTTO is extremely content with the crowdtests that Testbirds has conducted. This e-retailer’s comprehensive webshops are produced by teams in an international setting. Through crowdtesting, OTTO not only received feedback on issues, but also positive confirmation that their channels work well for customers in the Dutch market. This testing approach is regarded as a cost-efficient one by the company.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets and smartphones
Software: Extranet GLORIS
Usecase: Crossbrowser Tests

TESTERS

Number: 10
Nationality: DE

Rohde & Schwarz tests its extranet with the help of Testbirds‘ Crowd

QUALITY ASSURANCE

Structured Bug Testing

QUALITY ASSURANCE

Exploratory Bug Testing

Rohde & Schwarz provided a new extranet for its sales and service employees as well as business customers. “Due to limited internal resources besides high time pressure, crowdtesting was the ideal solution for quality assurance. In order to avoid bad impressions, we didn‘t want to include our own employees during this development stage”, says Michael Söhner, Program Manager Extranet, Rohde & Schwarz.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets & smartphones
Software: Webshop sport-bittl.com

TESTERS

Number: 23
Alge: 21-49
Gender: 57% ♂ / 43% ♀
Nationality: DE
Skills: Passion for sports

BUGS

Total Bugs: 45

Sport Bittl: Sports enthusiast crowd helps to release a webshop

TESTBIRDS EXCLUSIVES

BugAbility™

Sport Bittl has been firmly established among the well-known sports shops in Munich for decades. To ensure that the Munich sports dealer can continue to fulfil its customers’ wishes at the usual level while shopping online, the shop has been redesigned at www.sport-bittl.com. Prior to the release, the new webshop needed to be tested by representatives of the target group, so Sport Bittl chose to do a crowd test with Testbirds. In the context of a so-called BugAbility™ study, the focus was to find functional bugs in the beta version of the webshop as well as to get feedback about its usability.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktops, tablets and smartphones
Software: Website Sueddeutsche.de
Usecase: Crossbrowser / Crossdevice Tests

TESTERS

Anzahl: 51
Alter: 18 – 60
Nationalität: DE

Süddeutsche.de tests their digital channels with Testbirds

USABILITY & UX

Usability and UX Study

QUALITY ASSURANCE

Exploratory Bug Testing

USABILITY & UX

Competitor Analysis

Süddeutsche.de is one of the largest national news channels in Germany. Testbirds was commissioned to test the usability of the website for both desktop and mobile Internet, compared to other national news channels. “The test results gave us very good indications of what we need to attach special importance to in further development,” says Johannes Vogel, Managing Director Süddeutsche Zeitung Digitale Medien GmbH.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Smartphone
OS: Android / iOS
Software: Veon App

TESTERS

Number: 40
Age: 18 – 45
Nationality: Russia, Pakistan

VEON – An A/B Comparison Study

USABILITY & UX

Comparison Study

VEON, one of the world’s largest Telco companies, invested in an A/B comparison study on the user interface (UI) for their new app with Testbirds, using a group of 40 participants based in Pakistan and Russia that matched VEON’s target audience. The results of this A/B comparison study were used to determine which UI version (A or B) was more engaging for VEON’s target audience. Real world testing with native testers ensured that the app was well received in VEON’s target markets: Russia and Pakistan.

DOWNLOAD FULL CASE STUDY

DEVICES/SOFTWARE

Devices: Desktop (Windows / MAC)
Software: Website vfl-wolfsburg.de
Usecase: Crossbrowser Tests (Safari, Chrome, IE, FF) / Usability

TESTERS

Number: 2
Age: 18 – 59
Nationality: DE

Football 2.0: Testbirds tests www.vfl-wolfsburg.de

USABILITY & UX

Usability and UX Study

QUALITY ASSURANCE

Exploratory Bug Testing

German Bundesliga club VfL Wolfsburg had its website recently reviewed by Testbirds for user experience
and bugs through different use cases. Oliver Gliß, Webmaster VfL Wolfsburg, is very happy with the results of the test: “Due to the comprehensive feedback we received from Testbirds, we gained a good understanding and interesting overview on how things stand regarding the visual and functional operability of our web services. The outcome helped us to have a successful start to the second half of the season.“

DOWNLOAD FULL CASE STUDY

Innovative App & Web Testing

Watch our masterclass video series on QA & UX Testing - as seen on The Telegraph & Business Reporter. Discover with our CEO & host Philipp Benkler how to optimize your digital products in the best way possible.

1und1-testbirds-crowdtesting  ACE Bug test app  ANWB Usability Test  Appitized Bugability  Arvato - Chatbot Testing  Assmann - End-to-End Bugability  Audi - UX-Study  Baur- Bugtesting  Bayernatlas - Bugfixing  Bittl - Bugability  bmw-logo-crowdtesting-testbirds  Braun - Bugability  CEBIT - Bug Testing  Celonis - Bugability  DATEV - Usability  Deutsche Bahn - Crowdtest  Deutsche Messe - Website testing  Deutsche Post - Bug Testing  Telekom - Test Automation  Die Welt - Website Testing  DM -Bug Testing  DHL - Bugability  Dr. Oetker - Bugtest  Elitepartner - App Testing  Evening Standard - Website Testing  Webshop Testing  App Testing  Bugability  End-to-End Testing  Immowelt - Website Testing  Interhyp - Remote Interviews  Comparison Study  User Experience Test  Training Academy  Bug Testing  Crowdtesting Exploratory Bugtest  Website Testing  Webshop Testing  Usability Study  Device Cloud - manual testing  Load Testing  Webshop Testing  Bugability  Website Testing  Bug Testing  Webshop Bug Testing  Bug testing  Crowdtesting  Bugability


chatbot partner  Crossbrowser testing  testbirds partnership  Partnership  Mobile Testing partnership  crowdtesting qa partner   game testing partner   crowdtesting partner

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact