Comparison Study

Design, navigation, colours user, lengths of text… there are a variety of methods how content is being displayed on websites. Find out what your end users prefer and, most importantly, why!



Over 400,000 users registered worldwide


Target group-specific selection of testers based on over 65 criteria


Tests under real conditions, no artificial environments


Individual test design matching your personal requirements


Several tester groups or one group with several options


Applicable in all stages of development

Take the quality of your applications to the next level!

The challenge: Version A or Version B?

While the old adage, “it’s what’s on the inside that counts” applies to software testing, the outside, is almost just as important. It’s not unusual for designers and the people responsible for a project to have their own preferences about how a website or app should look like or how content is best displayed. However, thanks to the subjective nature of these matters, these preferences do not always match those of real users. Should you opt for round buttons or square boxes? Muted or bright colours? Texts with two or three columns? With all these options it’s easy to lose sight of your user’s desires.

The solution: Consult your target group!

On our platform there are over 400,000 testers registered. With the help of more than 65 demographic criteria such as jobs and hobbies, we can choose testers that match your potential target group. The crowd then supports you by finding out if you should choose options A or B and tells you exactly why one alternative is better than the other from the point of view of the end user. From wireframes and click dummies all the way up to finalised websites, comparison tests can be used in all stages of development. We create a custom test design based on your requirements and the questions you would like answered. Let the testers decide between different colours, various text layouts and navigation styles. It’s also possible to choose two tester groups that each test only one of the alternatives and provide you with feedback regarding only option A or B. Our Comparison Tests give you invaluable insights into the requirements of your target group that surpass the results of pure A/B testing.

How it looks in practice

Green or red? One of our clients operating in the sports industry could not decide what the main colour of their logo and digital presence should be during a renovation of their design. 50 crowdtesters who matched the criteria of their target group (mostly male, between 20 and 45 years old who were also sports enthusiasts with an annual income of over 50,000 euros) were consulted. The testers were then randomly divided into two groups. After, they were asked to answer 5 qualitative and 5 quantitative questions. A number of key messages that the brand and the new design should deliver to users had been prepared in advance. The testers were then asked to rate from 1 to 10 how much they agreed that the shown layout matches those key messages. After evaluating the questionnaires the results clearly indicated that the green design was not only preferred by testers because of its visual appearance, but was also rated as better matching the company’s key messages.


VEON – An A/B Comparison Study
“The team at Testbirds convinced us with a thorough pitch and a ‘can do’ attitude despite the tight deadline and disparate nature of the territories involved in the test.(…)The results of the A/B comparison UI test for content discovery on VEON had a direct impact on the platform and business and we are grateful for Testbird’s efforts. I wouldn’t hesitate to work with them again”
David Kane, Director of Editorial Content, VEON

Testing Reality

Testing Reality. Real users. Real devices. Real time.
Testbirds Crowdtesting & cloud-based solutions enables you to optimise your digital products and your customers experience. Tackle now all bugs and usability issues in your product with the help of our innovative technologies.

Innovative App & Web Testing

Watch our masterclass video series on QA & UX Testing - as seen on The Telegraph & Business Reporter. Discover with our CEO & host Philipp Benkler how to optimize your digital products in the best way possible.

1und1-testbirds-crowdtesting  ACE Bug test app  ANWB Usability Test  Appitized Bugability  Arvato - Chatbot Testing  Assmann - End-to-End Bugability  Audi - UX-Study  Baur- Bugtesting  Bayernatlas - Bugfixing  Bittl - Bugability  bmw-logo-crowdtesting-testbirds  Braun - Bugability  CEBIT - Bug Testing  Celonis - Bugability  DATEV - Usability  Deutsche Bahn - Crowdtest  Deutsche Messe - Website testing  Deutsche Post - Bug Testing  Telekom - Test Automation  Die Welt - Website Testing  DM -Bug Testing  DHL - Bugability  Dr. Oetker - Bugtest  Elitepartner - App Testing  Evening Standard - Website Testing  Webshop Testing  App Testing  Bugability  End-to-End Testing  Immowelt - Website Testing  Interhyp - Remote Interviews  Comparison Study  User Experience Test  Training Academy  Bug Testing  Crowdtesting Exploratory Bugtest  Website Testing  Webshop Testing  Usability Study  Device Cloud - manual testing  Load Testing  Webshop Testing  Bugability  Website Testing  Bug Testing  Webshop Bug Testing  Bug testing  Crowdtesting  Bugability

chatbot partner  Crossbrowser testing  testbirds partnership  Partnership  Mobile Testing partnership  crowdtesting qa partner   game testing partner   crowdtesting partner

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact