Select Page

“It’s not a bug, it’s a feature”

by | Oct 2, 2015 | QA, Software bugs & malfunctions, Terms from the world of IT explained | 0 comments

While Linux fans attribute the quote used in the title to Linus Torvalds, Windows supporters argue that it was Bill Gates who said it, while Apple admirers swear it belongs to Steve Jobs. Fortunately, for us, the author is of little relevance. The differentiation, on the other hand, undoubtedly is. Every person makes mistakes and developers are no exception. Sometimes, though, what we accidentally perceive as a mistake is in fact completely intentional. In its past, Testbirds has had numerous encounters with this misunderstanding. Therefore we would like to explain, step by step: Is it a bug or is it a feature?

There is a rumor that in 1947 a real life bug, meaning insect, was trapped in a relay in Harvard’s Mark II computer, thereby coining the word “bug” in the IT industry. In that context, a bug is defined as “an error, flaw, failure, or fault in the computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.” Practically speaking, though, what makes a bug a bug? Trust me; we are veterans when it comes to test reports. All kinds of test reports. Reports that provide too little information, reports filled with wrong information, reports which state problems that only occur because of wrong software usage. But also, wonderful, clear, helpful and informative reports!  The rule of thumb here is: “If your bug is not reproducible, it will never get fixed.” Therefore, it is good practice if after a bug is found, you try to make it appear again. We do like problems that are reproducible, and happy Testbirds can analyze reports faster and more effectively.

Malfunctions, app crashes, spelling mistakes and display errors

At Testbirds, we use several categories of bugs: there are for instance malfunctions, app crashes, spelling or grammar mistakes and display errors. Malfunctions and app crashes are usually more critical: they vary from medium to extremely important. To find out more about those, take a look at our software fails series …they are bad. Spelling/grammar mistakes and display errors are generally classified as lower in severity. If pictures and buttons are sticking, even though the page has been scrolled down, or there is overlaid content, this is called a display error.

Sounds simple, right? However, these guidelines are not strict and that’s the tricky part: it is always important to use common sense instead of adhere to stringent guidelines. If a company is mistyping its own name on the main page, it should not be considered a less important mistake! This is why in addition to the ranking from low to critical, it is utterly important to use questions that help our Birdmasters rank a bug’s severity. Is there a workaround? Does the bug affect main functions? Those and many more questions might make the Birdmasters give preference to bugs that are generally classified as low in severity.

What does this mean for testing?

However, let’s think of a few other examples: What if the text isn’t shaped nicely around the picture or if the text is unreadable because it is too small or in the wrong color? If you report a suggestion for change for the existing or new functions to make the application better, it’s called usability issues, which, strictly speaking, are not bugs. And what if you are supposed to test an app in flight mode and various functions no longer work? What about if the app automatically switches to landscape mode? If the design changes? Those things might confuse the tester but are meant to be a “feature”. We call that the Testbirds dilemma: we want our testers to look at software from an unbiased perspective and we also don’t ask our clients for any software specifications. This means that borderline cases can happen, where it is hard to define whether a bug reported by a tester is actually a bug, a feature or a usability issue. One possible way to handle this is to accept the bug report with a low severity and in the cases of a BugAbility™ test the problem should also be mentioned in the usability part of the testing process.

So the number one rule is: no machine in this world can replace human common sense as there will always be exceptions.


Bugs made by Freepik from is licensed by CC BY 3.0

Share it if you like it:

Tag Cloud

Other content that might be interesting for you:

Testbirds redefines mobile testing!

From February 27th to March 2nd, at the Mobile World Congress in Barcelona, we will be launching a newly developed testing solution: The Global Real...

Co-innovation: A trending concept that requires testing

After rounding off the latest edition of IFA Berlin, the trends of the past year have come to light and the global reach of the event seems larger...

Coming to dmexco? Win an UX workshop for your digital product!

Let’s talk about UX! Meet us at #dmexco17 for expert insights and a chance to win a UX workshop including €4,000 testing credit! On September 13th...

Want to play buzzword-bingo? Let’s talk about AI and 5G!

AI is obviously one of the key topics for this year’s Mobile World Congress starting next week. In this context, the “transformative effect on...

Latest trends in the travel segment

As a frequent traveller, I always try to be on top of the latest travel apps to make life easier when preparing for my holidays. Remember the time...

A New Nest for the Testbirds

Some of you might have seen it already - We have a new nest! The development and project management team have worked very hard and now a completely...

Meet our Top Tester in Sweden: Markus

This month we have invited our Top Tester from our crowd in Sweden, Markus, to the blog to hear about his experience testing with us Hi Markus, and...

Testbirds Exclusives: a look into our special test solutions

As you may have noticed, we’re very proud to have released new testing services within our service portfolio. Two weeks ago, Franzi already gave you...

The countdown for MWC 2019 begins! Win a ticket to our exclusive event

It's almost our favorite time of the year. Only one month to go before the Mobile World Congress in Barcelona! From February 25-28, we are back...

Bringing our offline world online – the Internet of Things

More and more connected home devices are becoming part of our everyday lives, whether its controlling your heating from outside your home, turning...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact