Design, navigation, colours user, lengths of text… there are a variety of methods how content is being displayed on websites. Find out what your end users prefer and, most importantly, why!
COMPARISON STUDY – YOUR ADVANTAGES
Over 400,000 users registered worldwide
Target group-specific selection of testers based on over 65 criteria
Tests under real conditions, no artificial environments
Individual test design matching your personal requirements
Several tester groups or one group with several options
Applicable in all stages of development
Take the quality of your applications to the next level!
The challenge: Version A or Version B?
While the old adage, “it’s what’s on the inside that counts” applies to software testing, the outside, is almost just as important. It’s not unusual for designers and the people responsible for a project to have their own preferences about how a website or app should look like or how content is best displayed. However, thanks to the subjective nature of these matters, these preferences do not always match those of real users. Should you opt for round buttons or square boxes? Muted or bright colours? Texts with two or three columns? With all these options it’s easy to lose sight of your user’s desires.
The solution: Consult your target group!
On our platform there are over 400,000 testers registered. With the help of more than 65 demographic criteria such as jobs and hobbies, we can choose testers that match your potential target group. The crowd then supports you by finding out if you should choose options A or B and tells you exactly why one alternative is better than the other from the point of view of the end user. From wireframes and click dummies all the way up to finalised websites, comparison tests can be used in all stages of development. We create a custom test design based on your requirements and the questions you would like answered. Let the testers decide between different colours, various text layouts and navigation styles. It’s also possible to choose two tester groups that each test only one of the alternatives and provide you with feedback regarding only option A or B. Our Comparison Tests give you invaluable insights into the requirements of your target group that surpass the results of pure A/B testing.
How it looks in practice
Green or red? One of our clients operating in the sports industry could not decide what the main colour of their logo and digital presence should be during a renovation of their design. 50 crowdtesters who matched the criteria of their target group (mostly male, between 20 and 45 years old who were also sports enthusiasts with an annual income of over 50,000 euros) were consulted. The testers were then randomly divided into two groups. After, they were asked to answer 5 qualitative and 5 quantitative questions. A number of key messages that the brand and the new design should deliver to users had been prepared in advance. The testers were then asked to rate from 1 to 10 how much they agreed that the shown layout matches those key messages. After evaluating the questionnaires the results clearly indicated that the green design was not only preferred by testers because of its visual appearance, but was also rated as better matching the company’s key messages.
VEON – An A/B Comparison Study
“The team at Testbirds convinced us with a thorough pitch and a ‘can do’ attitude despite the tight deadline and disparate nature of the territories involved in the test.(…)The results of the A/B comparison UI test for content discovery on VEON had a direct impact on the platform and business and we are grateful for Testbird’s efforts. I wouldn’t hesitate to work with them again”
David Kane, Director of Editorial Content, VEON
Testing Reality. Real users. Real devices. Real time.
Testbirds Crowdtesting & cloud-based solutions enables you to optimise your digital products and your customers experience. Tackle now all bugs and usability issues in your product with the help of our innovative technologies.
Start your first test now
Test and optimise your websites, apps, games, chatbots and Internet of things applications with the help of our innovative services