Select Page

According to Gartner, more than 2.4 billion tablets and mobile phones were shipped by the end of 2014. The Apple App store and Google Play store each offer more than one million apps for users to download to their devices. So what keeps users from sticking to a specific app rather than switching to the next one? The basic functionality of an application needs to run flawlessly and solve the consumers’ need in an intuitive fashion.

Consumers engage with mobile applications in a completely different way than they engage with websites. Given the ever-growing diversity of mobile devices, operating systems and form factors (e.g. smartphone, phablet, and tablet) in the market, mobile testing has never been more important to ensure that mobile application users have a positive experience.

Functional Testing

Never before has functional testing been as challenging as in the mobile app industry. An ever-growing landscape of devices and OS versions requires a complex matrix of testing factors in order to perform functional testing sufficiently. It is key for your testing team to identify the device matrix relevant for your user base.
Choosing the sufficient and right devices for your testing matrix relies on several aspects:

  1. Your market vertical (banking, healthcare, digital media, etc.)
  2. Your own production analytics – realize which devices are mostly used by your end-users to access your servers and your apps and on which OS versions
  3. Market dynamics – do not lose sight of the market evolvement and innovations – new smartphones, tablets and even wearables pop up periodically and need to be considered in your overall device matrix.

Usability Testing

As user experience becomes key to business success and app adoption, usability testing ought to be part of any mobile app test plan.
Achieving high app usability can be achieved through Single User Performance testing early in the development cycle, which includes vitals testing (CPU, Battery, memory leaks etc.) as well as network condition testing (latency, packet losses, behavior in various network types like 2G, 3G, LTE, Wifi). Usability testing can also be done with proper adherence to the platform vendor’s design guides (Apple, Google). The important thing to keep in mind that the mobile app needs to:

  • Function well on various devices, OS versions
  • Provide good user experience from a performance perspective
  • Be intuitive to the users (easy navigation, meaningful error messages)
  • Solve a problem or meet the need of its users
  • Adhere to the platform vendor guide lines (do not re-invent the wheel) – end-users expect UI that they know from other apps, provide them similar experience

Testing with the Crowd

Android Device Fragmentation
Crowdtesting enables companies to gather insights and feedback from their prospective users at any time during the development process. This is relevant in order to tailor an application to the specific needs of your target group. A well-performing and functioning app could still get negative reviews if it doesn’t address the user’s needs.
The added values of crowdtesting returned to the application team are as follows:

  • Selection of specific demographics (education, hobbies, online behavior etc.), offering access to any target group, as well as specifix devices and operating systems
  • Access to specific users & professional testers at any time, which reduces testing times
  • Applicable in all stages of the development process in order to ensure development close to the user’s needs:

Opening up your application to a select crowd of users before launch increases chances of success after release tremendously, given the test setup is reliable and their feedback is incorporated. Confidentiality agreements as well as high security standards prevent a leak of information before launch.

Releasing a mobile app or several apps is always a great challenge, a challenge that continues to become more complex as mobile devices and OS platforms progress with innovative features. Mobile app vendors need to keep in mind that end-user expectations are also rising – you need to be on top of the market and react quickly to changes.

The whitepaper “Crowdtesting: An Overview” offers a deeper look into the possibilities of crowdbased testing methods.

Share it if you like it:

Tag Cloud

Other content that might be interesting for you:

Interesting takeaways from Google I/O 2016

Two weeks ago, it was time yet again for Google I/O, Google's annual conference for developers. The tech world was eagerly looking forward to see...

Our step into the automotive world: Testbirds is partnering with….?

…the BMW Group! Today we are excited to announce a comprehensive contract. First, let me start at the very beginning. Our journey started with...

MWC 2018: Win a testing budget & VIP-party-bus tickets

As we wrote in one of our last posts, this year we will attend again the Mobile World Congress 2018, the world’s largest gathering for the mobile...

Step by step: How to create an evolutionary organisation

As part of my blog series about our organisation principle Orga 4.0, I’d like to share some thoughts today about creating a company that is...

Unicorns, Business Angels and Scale-Ups

Start-up, Scale-up, Business Angel, Unicorn, Venture capital – What do all these terms describe? Let’s have a guess… maybe “start-up” or “scale-up”...

Meet our Testers: Michele from Italy

For our first tester interview of the year we decided to interview Michele, one of our top testers in Italy who recently participated in a test that...

The Nest during the holiday season

Testbirds love Christmas. Especially here in Munich, with all those beautiful christmas markets in the city and winter festival Tollwood just around...

Testbirds @ Mobile World Congress – Join us in Barcelona and win a Sonos One smart speaker!

Testbirds will be at the Mobile World Congress 2018, the world’s largest gathering for the mobile industry! The event will take place from February...

We’ve flown a long way – the past year at Testbirds

As 2018 is coming to an end we look back over the year that has passed and a few of the many exciting moments we’ve experienced. The most impactful...

An Overview: Testing methods for Online-Shops

As you might have picked up already, in July we address E-Commerce testing a lot on our Testbirds blog. In the last weeks we already tackled down...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact