Design, navigation, colours user, lengths of text… there are a variety of methods how content is being displayed on websites. Find out what your end users prefer and, most importantly, why!
COMPARISON STUDY – YOUR ADVANTAGES
Over 250,000 users registered worldwide
Target group-specific selection of testers based on over 60 criteria
Tests under real conditions, no artificial environments
Individual test design matching your personal requirements
Several tester groups or one group with several options
Applicable in all stages of development
Take the quality of your applications to the next level!
The challenge: Version A or Version B?
While the old adage, “it’s what’s on the inside that counts” applies to software testing, the outside, is almost just as important. It’s not unusual for designers and the people responsible for a project to have their own preferences about how a website or app should look like or how content is best displayed. However, thanks to the subjective nature of these matters, these preferences do not always match those of real users. Should you opt for round buttons or square boxes? Muted or bright colours? Texts with two or three columns? With all these options it’s easy to lose sight of your user’s desires.
The solution: Consult your target group!
On our platform there are over 250,000 testers registered. With the help of more than 60 demographic criteria such as jobs and hobbies, we can choose testers that match your potential target group. The crowd then supports you by finding out if you should choose options A or B and tells you exactly why one alternative is better than the other from the point of view of the end user. From wireframes and click dummies all the way up to finalized websites, comparison tests can be used in all stages of development. We create a custom test design based on your requirements and the questions you would like answered. Let the testers decide between different colours, various text layouts and navigation styles. It’s also possible to choose two tester groups that each test only one of the alternatives and provide you with feedback regarding only option A or B. Our Comparison Tests give you invaluable insights into the requirements of your target group that surpass the results of pure A/B testing.
How it looks in practice
Green or red? One of our clients operating in the sports industry could not decide what the main colour of their logo and digital presence should be during a renovation of their design. 50 crowdtesters who matched the criteria of their target group (mostly male, between 20 and 45 years old who were also sports enthusiasts with an annual income of over 50,000 euros) were consulted. The testers were then randomly divided into two groups. After, they were asked to answer 5 qualitative and 5 quantitative questions. A number of key messages that the brand and the new design should deliver to users had been prepared in advance. The testers were then asked to rate from 1 to 10 how much they agreed that the shown layout matches those key messages. After evaluating the questionnaires the results clearly indicated that the green design was not only preferred by testers because of its visual appearance, but was also rated as better matching the company’s key messages.
OS: Android / iOS
Software: Veon App
Age: 18 – 45
Nationality: Russia, Pakistan
VEON – an A/B Comparison Study
VEON, one of the world’s largest Telco companies, invested in an A/B comparison study on the user interface (UI) for their new app with Testbirds, using a group of 40 participants based in Pakistan and Russia that matched VEON’s target audience. The results of this A/B comparison study were used to determine which UI version (A or B) was more engaging for VEON’s target audience. Real world testing with native testers ensured that the app was well received in VEON’s target markets: Russia and Pakistan.