Skip to main content
Case Study

How e-retailer OTTO optimizes its online shops through crowdtesting

To assist OTTO with their recurring functionality and usability testing, Testbirds crowdtesters – in addition to OTTO’s internal test processes – check any adjustments to their e-commerce website that were deployed the previous month.

Download Case Study
Otto logo
Every second a site loads faster, conversion rates improve by up to 17%.
The average conversion rate of online shops across industries is 2.2%
It was found that usability testing with 5 users would find around 85% of the problems in an interface.
MARTINA TERZIC Marketing Analyst, Product Owner CRO/UX, OTTO

“I’ve always experienced the communication with Testbirds to be flexible and fast. They genuinely consider the tester distribution, which is great. And, of course, they make sure that the crowdtests run smoothly, so you don’t have to worry about a thing. Afterwards, Testbirds also organizes a debriefing to evaluate the test, the results, and the process in general.”

Test object

Website

Otto BV is one of the largest companies within the internationally operating Otto Group, an established organisation with a long history in home shopping. OTTO is extremely content with the crowdtests that Testbirds has conducted. This e-retailer’s comprehensive webshops are produced by teams in an international setting. Through crowdtesting, OTTO not only received feedback on issues, but also positive confirmation that their channels work well for customers in the Dutch market. This testing approach is regarded as a cost-efficient one by the company.

BugAbility
Exploratory Bug Testing
Devices / Software Devices: Desktops, tablets & smartphones
Software: Webshop

Testers Number: 116
Nationality: NL
Achievements Total Bugs: 249
Otto Case Study cover
DESKTOPS, TABLETS, AND SMARTPHONES
116 TESTERS
6 MONTHS

OTTO

Otto BV is one of the largest companies within the international Otto Group.

With over 50,000 employees and operating in over 30 countries in North and South America, Europe, and Asia, OTTO is an established leader in e-commerce with one of the widest ranges of consumer lifestyle products in the fashion, home, and electronics markets.

OTTO strives to offer its customers the best possible shopping experience.

Headquarters

Hamburg, Germany

Employees

50,000

Industry

Retail

Company Website

OTTO.nl

Client's needs

Within OTTO, short continuous development life cycles are common. Resources can present a challenge, however, as they run weekly deployments where they aim to go live with new or adjusted functionalities.

This can range from small color changes to completely new check-out integrations. All functionalities must work well for their customers and be user-friendly at the same time.

CORNY VAN DE WAL
Team Manager Shop Development & Production, OTTO

“By crowdtesting on the right devices with the right browser versions and operating systems, Testbirds helps us to constantly deliver more customer-friendly websites.”

Test setup

To assist OTTO with their recurring functionality and usability testing, Testbirds crowdtesters – in addition to OTTO’s internal test processes – check any adjustments to their e-commerce website that were deployed the previous month.

Because the testers use their own devices they can provide direct feedback on any functional issues or problems within the usability of OTTO’s online channels.

All identified bugs are registered in Testbirds’ platform before Testbirds’ project managers proactively support the crowdtests, and guide OTTO through all projects.

Send us an Inquiry

Ready to learn more about crowdtesting?

Get in Touch

Results

Because OTTO’s webshops are produced by teams in an international setting, ensuring consistent and standardized localization is extremely important to delivering a positive user experience.

With crowdtesting, OTTO not only quickly received feedback on any issues found but were given positive confirmation that their channels work as intended for customers in the Dutch market.

Crowdtesting also proved to be highly cost-effective, with Testbirds crowdtesters using their own devices, which meant there was no infrastructure to be set up or devices to be acquired or maintained.

For OTTO, having bugs removed from their channels not only improves their chances of increasing sales but enhanced customer retention through an optimized user experience.

Otto mockup
CORNY VAN DE WAL Team Manager Shop Development & Production, OTTO

“We have a continuous process of change, adjustment, and improvement. Testbirds offer their testing solutions with the same flexibility and agility, which made us decide to embed their testing services continuously into our development cycle.”

Testbirds Insights

Exploratory Bug Testing

Get real insights into your product’s functionality. Let our Crowd check your digital product for bugs you never expected to find.

Find out more
Exploratory Bug Testing icon
Testbirds is certified by: