Swarm Intelligence for Development: Crowdtesting at Celonis
For the project, 20 testers were chosen who closely matched the product’s intended target group.
Download Case Study“After we came to the conclusion that internal testing simply is not enough for us anymore, we decided to do crowdtesting. If the product reaches a certain degree of complexity, internal testing requires too many resources. Furthermore, unbiased testers find mistakes, which would remain undiscovered otherwise.”
Celonis Process Mining software
Analysing and optimising business processes with artificial intelligence – that is what the process mining software by Celonis does. The further development of the software platform focuses on high speed in terms of innovation as well as ensuring it runs without bugs and is user friendly. This motivated Celonis to perform a crowdtest with Testbirds. Previously, the company only tested internally with their own employees. When doing this most enterprises face the issue of institutional blindness.
Celonis
Munich, Germany
1,800+ worldwide
Electronics
Client's needs
The Celonis Execution Management Platform hosts a range of apps that extract system data in real-time to help identify execution gaps while automating routine business decisions.
The system must be fast, free of bugs, and user friendly.
However, as their solution continues to grow in features and complexity, internal testing became too time-consuming and there were concerns about internal testers missing obvious issues because of their familiarity with the software.
Test setup
For the project, 20 testers were chosen who closely matched the product’s intended target group.
While the majority of testers were male, all worked in Finance, Controlling, and IT, and came from a variety of countries; just like the clients of Celonis.
Results
The testers mainly found visual bugs and incorrectly displayed elements. For example, diagrams not shown correctly, or translation issues that led to a page not being displayed consistently in, for example, German or English. The testers also found inaccurate translations.
Based on this, Celonis created a process analysis for all language versions and improved the quality of the translations.
Very few functional bugs were discovered.
Furthermore, the usability feedback of the testers showed that they sometimes acted in different ways compared to the expectations of the Celonis developers, highlighting the benefits of using unbiased testers.
BugAbility™
No room for bugs and usability issues? Combine QA and UX testing and get the best of both worlds.
Find out moreWe provide you with the latest insights from the world of crowdtesting
Stop guessing if your product meets your users' expectations and start making decisions based on facts.