How Qobuz uses crowdtesting to meet customer demands for quality
All tests were run on the alpha app for both iOS and Android, on several different devices, with Testbirds crowdtesters in Qobuz’s key markets. Use cases included creating an account, using the search and filter functions, creating playlists, toggling dark mode, evaluating offline usage, and confirming connectivity with streaming devices for both home and car use.
Download Case Study
“We like to see quality, on the one hand, as materializing user expectations, and on the other as minimizing bad experiences. Here at Qobuz, quality assurance is what gives us confidence in the value delivered to our customers through our product.”
Qobuz app
Qobuz provides its customers with high-quality music streaming and editorial content to go with it. Ensuring that the experiences in their apps match the quality their customers expect from their listening experience is a process of improvement that Qobuz takes seriously and that puts them at the forefront of streaming services.
Qobuz
Named after an old Kazakh instrument, the Qobuz music streaming and download service delivers over 70 million tracks at 24-bit high-resolution quality.
They not only provide music from new and established artists, but they also provide recommendations, interviews, articles, reviews, and much more, to people who love music.
This exceptional user experience extends to the Qobuz app – the primary touchpoint for their subscribers to enjoy the music.
Paris, France
75
Music streaming and downloads
Client's needs
To continuously deliver the highest quality user experiences, Qobuz regularly tests their app to find areas for improvement. This includes finding bugs that may negatively affect the user experience or hinder the usage of the app.
Chief Customer Officer, Qobuz
“We’re a customer-centric company, and part of our strategy is that we want to be as close to the customer as possible. Crowdtesting puts our product in the hands of regular users in order to get pre-emptive feedback. We carefully select testers in our key markets, with profiles that closely match our customer base.”
With a global audience, this meant finding testers that closely resembled their users, who used similar devices and had similar expectations to what the app would – and could – deliver.
Test setup
All tests were run on the alpha app for both iOS and Android, on several different devices, with Testbirds crowdtesters in Qobuz’s key markets. Use cases included creating an account, using the search and filter functions, creating playlists, toggling dark mode, evaluating offline usage, and confirming connectivity with streaming devices for both home and car use.
Qobuz chooses to focus on product improvements early on in development as this saves future resources. Bugs and issues can be fixed promptly rather than being carried forward into future versions – where the app has become more complex, and finding and fixing bugs is more difficult.
Results
Putting the Qobuz app in front of crowdtesters, who used it exactly as a real user would meant that Qobuz was able to improve the quality of their product by testing in their key markets and on more devices than they have in-house – without affecting their actual subscribers. With this increased test coverage and the integration of crowdtesting into their existing quality assurance practices, Qobuz eased the workload for their QA engineers and put even more effort into creating an experience centered around their customers’ wants and needs.
The majority of bugs found were of low to medium severity, which meant they didn’t stop the user from using the app. However, they did affect the user experience. For example, by not displaying the correct song, or having minor spelling and grammar mistakes. By running these tests and improvements, we helped to ensure that bugs, such as app crashes or not being able to sign up for a subscription, were eliminated from the user experience.
Testers also supplied detailed feedback on the app’s look and feel. This helped ensure the app delivered an exceptionally user-friendly, dependable, and quality service.
On any device at any time.
“It’s a real pleasure working with Testbirds. They have helped us to vastly increase our test coverage with various user configurations and devices. Their international presence in our key markets, along with their integration with our existing tools and adaptation to our processes, make them a good match for Qobuz.”
Structured Bug Testing
Make sure the core functions of your digital product are bug-free. Let the Crowd test it step-by-step according to detailed use cases.
Find out more
We provide you with the latest insights from the world of crowdtesting
Stop guessing if your product meets your users' expectations and start making decisions based on facts.
