Comparison Study

Design, navigation, colours user, lengths of text… there are a variety of methods how content is being displayed on websites. Find out what your end users prefer and, most importantly, why!

COMPARISON STUDY – YOUR ADVANTAGES

P

Over 250,000 users registered worldwide

P

Target group-specific selection of testers based on over 60 criteria

P

Tests under real conditions, no artificial environments

P

Individual test design matching your personal requirements

P

Several tester groups or one group with several options

P

Applicable in all stages of development

Take the quality of your applications to the next level!

The challenge: Version A or Version B?

While the old adage, “it’s what’s on the inside that counts” applies to software testing, the outside, is almost just as important. It’s not unusual for designers and the people responsible for a project to have their own preferences about how a website or app should look like or how content is best displayed. However, thanks to the subjective nature of these matters, these preferences do not always match those of real users. Should you opt for round buttons or square boxes? Muted or bright colours? Texts with two or three columns? With all these options it’s easy to lose sight of your user’s desires.

The solution: Consult your target group!

On our platform there are over 250,000 testers registered. With the help of more than 60 demographic criteria such as jobs and hobbies, we can choose testers that match your potential target group. The crowd then supports you by finding out if you should choose options A or B and tells you exactly why one alternative is better than the other from the point of view of the end user. From wireframes and click dummies all the way up to finalized websites, comparison tests can be used in all stages of development. We create a custom test design based on your requirements and the questions you would like answered. Let the testers decide between different colours, various text layouts and navigation styles. It’s also possible to choose two tester groups that each test only one of the alternatives and provide you with feedback regarding only option A or B. Our Comparison Tests give you invaluable insights into the requirements of your target group that surpass the results of pure A/B testing.

How it looks in practice

Green or red? One of our clients operating in the sports industry could not decide what the main colour of their logo and digital presence should be during a renovation of their design. 50 crowdtesters who matched the criteria of their target group (mostly male, between 20 and 45 years old who were also sports enthusiasts with an annual income of over 50,000 euros) were consulted. The testers were then randomly divided into two groups. After, they were asked to answer 5 qualitative and 5 quantitative questions. A number of key messages that the brand and the new design should deliver to users had been prepared in advance. The testers were then asked to rate from 1 to 10 how much they agreed that the shown layout matches those key messages. After evaluating the questionnaires the results clearly indicated that the green design was not only preferred by testers because of its visual appearance, but was also rated as better matching the company’s key messages.

DEVICES/SOFTWARE

Devices: Smartphone
OS: Android / iOS
Software: Veon App

TESTERS

Number: 40
Age: 18 – 45
Nationality: Russia, Pakistan

VEON – an A/B Comparison Study

USABILITY & UX

Comparison Study

VEON, one of the world’s largest Telco companies, invested in an A/B comparison study on the user interface (UI) for their new app with Testbirds, using a group of 40 participants based in Pakistan and Russia that matched VEON’s target audience. The results of this A/B comparison study were used to determine which UI version (A or B) was more engaging for VEON’s target audience. Real world testing with native testers ensured that the app was well received in VEON’s target markets: Russia and Pakistan.

DOWNLOAD FULL CASE STUDY





Data privacy statement consent
I have read the data privacy statement and can agree with it
Yes, i want to get offers via email

Start your first test

Test and optimise your websites, apps, software or Internet of Things applications with the help of our innovative services.

  ANWB Usability Test  Appitized Bugability  Assmann - End-to-End Bugability  Audi - UX-Study  Baur- Bugtesting  Bayernatlas - Bugfixing  Bittl - Bugability  Braun - Bugability  CEBIT - Bug TestingCelonis - Bugability  DATEV - Usability  Deutsche Bahn - Crowdtest  Deutsche Messe - Website testing  Deutsche Post - Bug Testing  Telekom - Test Automation  Die Welt - Website Testing  DM -Bug Testing  DHL - Bugability  Dr. Oetker - Bugtest  Elitepartner - App Testing  Evening Standard - Website Testing  Webshop Testing  App Testing  Bugability  End-to-End Testing  Immowelt - Website Testing  Interhyp - Remote Interviews  Comparison Study  User Experience  Training Academy  Bug Testing  Website Testing  Webshop Testing  Usability Study  Device Cloud  Load Testing   Webshop Testing  Bugability  Website Testing  Bug Testing  Webshop Bug Testing  Bug testing  Crowdtesting  Bugability  Bug Testing Webshop


  testbirds partnership        

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

I agree, to get marketing material from Testbirds: Get more info>


You have Successfully Subscribed!

Become a TESTER