“It’s not a bug, it’s a feature”

by | Oct 2, 2015 | QA, Software bugs & malfunctions, Terms from the world of IT explained | 0 comments

While Linux fans attribute the quote used in the title to Linus Torvalds, Windows supporters argue that it was Bill Gates who said it, while Apple admirers swear it belongs to Steve Jobs. Fortunately, for us, the author is of little relevance. The differentiation, on the other hand, undoubtedly is. Every person makes mistakes and developers are no exception. Sometimes, though, what we accidentally perceive as a mistake is in fact completely intentional. In its past, Testbirds has had numerous encounters with this misunderstanding. Therefore we would like to explain, step by step: Is it a bug or is it a feature?

bug-iconThere is a rumor that in 1947 a real life bug, meaning insect, was trapped in a relay in Harvard’s Mark II computer, thereby coining the word “bug” in the IT industry. In that context, a bug is defined as “an error, flaw, failure, or fault in the computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.” Practically speaking, though, what makes a bug a bug? Trust me; we are veterans when it comes to test reports. All kinds of test reports. Reports that provide too little information, reports filled with wrong information, reports which state problems that only occur because of wrong software usage. But also, wonderful, clear, helpful and informative reports! bug-iconbug-icon The rule of thumb here is: “If your bug is not reproducible, it will never get fixed.” Therefore, it is good practice if after a bug is found, you try to make it appear again. We do like problems that are reproducible, and happy Testbirds can analyze reports faster and more effectively.

Malfunctions, app crashes, spelling mistakes and display errors

At Testbirds, we use several categories of bugs: there are for instance malfunctions, app crashes, spelling or grammar mistakes and display errors. Malfunctions and app crashes are usually more critical: they vary from medium to extremely important. To find out more about those, take a look at our software fails series …they are bad. Spelling/grammar mistakes and display errors are generally classified as lower in severity. If pictures and buttons are sticking, even though the page has been scrolled down, or there is overlaid content, this is called a display error.

Sounds simple, right? However, these guidelines are not strict and that’s the tricky part: it is always important to use common sense instead of adhere to stringent guidelines. If a company is mistyping its own name on the main page, it should not be considered a less important mistake! This is why in addition to the ranking from low to critical, it is utterly important to use questions that help our Birdmasters rank a bug’s severity. Is there a workaround? Does the bug affect main functions? Those and many more questions might make the Birdmasters give preference to bugs that are generally classified as low in severity.bug-icon

What does this mean for testing?

However, let’s think of a few other examples: What if the text isn’t shaped nicely around the picture or if the text is unreadable because it is too small or in the wrong color? If you report a suggestion for change for the existing or new functions to make the application better, it’s called usability issues, which, strictly speaking, are not bugs. And what if you are supposed to test an app in flight mode and various functions no longer work? What about if the app automatically switches to landscape mode? If the design changes? Those things might confuse the tester but are meant to be a “feature”. We call that the Testbirds dilemma: we want our testers to look at software from an unbiased perspective and we also don’t ask our clients for any software specifications. This means that borderline cases can happen, where it is hard to define whether a bug reported by a tester is actually a bug, a feature or a usability issue. One possible way to handle this is to accept the bug report with a low severity and in the cases of a BugAbility™ test the problem should also be mentioned in the usability part of the testing process.bug-icon

So the number one rule is: no machine in this world can replace human common sense as there will always be exceptions.


Bugs made by Freepik from www.flaticon.com is licensed by CC BY 3.0

Share it if you like it:

Tag Cloud

About the author

Franziska Stieglmair

Franziska Stieglmair

PR & Marketing Manager

Franzi is our allround talent: Sie works in Marketing and Project Management. In her free time she prefers good movies and travelling.



Other content that might be interesting for you:

A (very) Brief History of Software Testing

Testing has been around longer than you would think and by extension software testing isn’t a relatively new concept either. Before markets became...

Testbirds Blog – Testing Reality

Testbirds Blog Welcome to Testing Reality - all the news about testing websites, apps and IoT applications About the blog This is the official...

Meet our Top Tester in Sweden: Markus

This month we have invited our Top Tester from our crowd in Sweden, Markus, to the blog to hear about his experience testing with us Hi Markus, and...

Video: Achieving a Seamless User Experience Through Testing

Today’s market for digital products is highly competitive. This has given rise to the necessity for companies to provide a high level of user...

A New Iteration – Our Recap of 2019

Ah, the end of another test cycle! Wait, no - the end of another year, that’s what it is. It’s difficult to keep testing out of your head once...

History’s Biggest Software Fails!

Software bugs can often have dire consequences, as we’ve noticed time and again on History’s Biggest Software Fails. While we’ve covered everything...

I’m Sahil and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so...

Testbirds receives investment in the millions

Testbirds receives investment in the millions Munich, 18th February 2016Testbirds, one of the world’s leading service providers of innovative...

I’m Laura Chung and This is My Role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

I am David and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact