Skip to main content

Webinar Recap | Adding the Human Factor to Agile Development


Webinar Recap | Adding the Human Factor to Agile Development

Recently we hosted a webinar together with Deutsche Telekom where we discussed the pros and cons of crowdtesting vs. test automation and introduced the audience to how Testbirds became the “external testing department” of Deutsche Telekom. 

Developing a New Webmail App – Challenges

When Deutsche Telekom started developing their new webmail app, the biggest challenge was the huge amount of data they had to deal with.

We’re talking about 24M mailboxes, 3.6M unique users, 50M emails daily, 215M saved contacts, and 18M address book accesses.

With this huge challenge, Telekom began to restructure its organization in the development teams and moved from waterfall to agile development. While using the waterfall model, development took 12 months followed by a testing phase of three months. During this testing phase there were literally 30 people sitting in a room clicking through all the test cases in different browsers and with different e-mail clients.

So overall, the rollout took over a year – if everything went smoothly.

Switching to agile development,suddenly the project had to be split into sprints that took one month each. As they were used to, the team added a testing phase of 14 days after each sprint. Developing and testing in the same way as before, but just in smaller “packages”, was okay for the first halfyear as they developed a completely new product. However, after some time, the code and software became so huge and complex that an extra test phase for regression testing was needed after every sprint, adding two extra weeks.
Once again, development took a lot of time which wadefinitely not the idea when switching to agile development in order to release quicker and more frequently 

Why Test Automation Wasn’t the Solution 

Deutsche Telekom was looking for a solution to make the test phase quicker and allow them to re-integrate test results into the sprint again. So, the idea was to automate the tests using the agile testing pyramid. That means that you usually test most functions with unit testing in the code, do a lot of integration testing, and only a small amount of manual end-to-end testing 

What Deutsche Telekom did was to start automating the end-to-end tests because it seemed like a good idea (but in hindsight it wasn’t the best solution). Deutsche Telekom invested a lot of time and resources in automating those end-to-end tests and keeping them running – time and resources that were missing in other crucial parts of the development life cycleSubsequentlythey decided to outsource their testing projects and make development resources available again for their actual product development 

Besides time and resources, Deutsche Telekom also had to deal with further challenges like device and sim card availabilitya missing testing infrastructure, and the need for testers who match the target audience of the different products and needs.  

That was the point when Deutsche Telekom started to investigate crowdtesting and its capabilities. To find out what Deutsche Telekom had to say about the advantages of crowdtesting, like the big pool of devices, the fast test setup and execution, and the independent view on the application, watch the full webinar.

Quote about Crowdtesting from Deutsche TelekomAlso, listen to David, Project Manager at Testbirds, who gave insights into the testing process for Deutsche Telekom and especially on rapid testing over a weekend and how we’re integrated into their development sprints. 

Are you interested in what crowdtesting can do for you and your company? Reach out to us, we’re happy to find a suitable solution for you and your digital product



We provide you with the latest insights from the world of crowdtesting

Stop guessing if your product meets your users' expectations and start making decisions based on facts.

Cracking the Code: Overcoming digital marketing’s challenges

Cracking the Code: Overcoming digital marketing’s challenges

Breaking Barriers: How to transform digital experiences for all

Breaking Barriers: How to trans­form digital experiences for all with accessibility testing

Welcome to the autoverse

Welcome to the Autoverse: Revolutionizing Connected Car Experiences

Marketing in a complex world

Marketing in a complex world: How crowdtesting can help you overcome the challenges

Press Releases

Testbirds sets new standards in information security with ISO 27001:2022 Certification

CX Trends 2024 featured

This time, it’s personal:
CX Trends for 2024

Why banking on crowdtesting is key for shaping secure, personalized experiences
Banking / Financial Services & Insurance

Why banking on crowdtesting is key for shaping secure, personalized experiences

Press Releases

Testbirds recognized as a representative vendor in Gartner’s Market Guide for Application Testing Services and Hype Cycle for UX

Learn how Testbirds empowered the customer experience in an app for a energy provider
Energy & Utilities

Empower your energy customers with an intuitive mobile app experience

Testbirds is certified by: