Comparison Study

Design, navigation, colours user, lengths of text… there are a variety of methods how content is being displayed on websites. Find out what your end users prefer and, most importantly, why!

The challenge: Version A or Version B?

While the old adage, “it’s what’s on the inside that counts” applies to software testing, the outside, is almost just as important. It’s not unusual for designers and the people responsible for a project to have their own preferences about how a website or app should look like or how content is best displayed. However, thanks to the subjective nature of these matters, these preferences do not always match those of real users. Should you opt for round buttons or square boxes? Muted or bright colours? Texts with two or three columns? With all these options it’s easy to lose sight of your user’s desires.

The solution: Consult your target group!

On our platform there are over 250,000 testers registered. With the help of more than 60 demographic criteria such as jobs and hobbies, we can choose testers that match your potential target group. The crowd then supports you by finding out if you should choose options A or B and tells you exactly why one alternative is better than the other from the point of view of the end user. From wireframes and click dummies all the way up to finalized websites, comparison tests can be used in all stages of development. We create a custom test design based on your requirements and the questions you would like answered. Let the testers decide between different colours, various text layouts and navigation styles. It’s also possible to choose two tester groups that each test only one of the alternatives and provide you with feedback regarding only option A or B. Our Comparison Tests give you invaluable insights into the requirements of your target group that surpass the results of pure A/B testing.

The Benefits of Comparison Study

  • Over 250,000 users registered worldwide
  • Target group-specific selection of testers based on over 60 criteria
  • Tests under real conditions, no artificial environments
  • Individual test design matching your personal requirements
  • Several tester groups or one group with several options
  • Applicable in all stages of development
  • Experienced project managers support and advise you about further actions

Take the quality of your applications to the next level!

How it looks in practice

Green or red? One of our clients operating in the sports industry could not decide what the main colour of their logo and digital presence should be during a renovation of their design. 50 crowdtesters who matched the criteria of their target group (mostly male, between 20 and 45 years old who were also sports enthusiasts with an annual income of over 50,000 euros) were consulted. The testers were then randomly divided into two groups. After, they were asked to answer 5 qualitative and 5 quantitative questions. A number of key messages that the brand and the new design should deliver to users had been prepared in advance. The testers were then asked to rate from 1 to 10 how much they agreed that the shown layout matches those key messages. After evaluating the questionnaires the results clearly indicated that the green design was not only preferred by testers because of its visual appearance, but was also rated as better matching the company’s key messages.

Start your first test

Test your websites, apps and Internet-of-Things Applications with the help of our innovative technologies.

Subscribe to the Testbirds Whistler!

Receive updates for webinars, innovative testing services and brand-new Nest features!

You have Successfully Subscribed!

Become a TESTER