Select Page

“It’s not a bug, it’s a feature”

by | Oct 2, 2015 | QA, Software bugs & malfunctions, Terms from the world of IT explained | 0 comments

While Linux fans attribute the quote used in the title to Linus Torvalds, Windows supporters argue that it was Bill Gates who said it, while Apple admirers swear it belongs to Steve Jobs. Fortunately, for us, the author is of little relevance. The differentiation, on the other hand, undoubtedly is. Every person makes mistakes and developers are no exception. Sometimes, though, what we accidentally perceive as a mistake is in fact completely intentional. In its past, Testbirds has had numerous encounters with this misunderstanding. Therefore we would like to explain, step by step: Is it a bug or is it a feature?

There is a rumor that in 1947 a real life bug, meaning insect, was trapped in a relay in Harvard’s Mark II computer, thereby coining the word “bug” in the IT industry. In that context, a bug is defined as “an error, flaw, failure, or fault in the computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.” Practically speaking, though, what makes a bug a bug? Trust me; we are veterans when it comes to test reports. All kinds of test reports. Reports that provide too little information, reports filled with wrong information, reports which state problems that only occur because of wrong software usage. But also, wonderful, clear, helpful and informative reports!  The rule of thumb here is: “If your bug is not reproducible, it will never get fixed.” Therefore, it is good practice if after a bug is found, you try to make it appear again. We do like problems that are reproducible, and happy Testbirds can analyze reports faster and more effectively.

Malfunctions, app crashes, spelling mistakes and display errors

At Testbirds, we use several categories of bugs: there are for instance malfunctions, app crashes, spelling or grammar mistakes and display errors. Malfunctions and app crashes are usually more critical: they vary from medium to extremely important. To find out more about those, take a look at our software fails series …they are bad. Spelling/grammar mistakes and display errors are generally classified as lower in severity. If pictures and buttons are sticking, even though the page has been scrolled down, or there is overlaid content, this is called a display error.

Sounds simple, right? However, these guidelines are not strict and that’s the tricky part: it is always important to use common sense instead of adhere to stringent guidelines. If a company is mistyping its own name on the main page, it should not be considered a less important mistake! This is why in addition to the ranking from low to critical, it is utterly important to use questions that help our Birdmasters rank a bug’s severity. Is there a workaround? Does the bug affect main functions? Those and many more questions might make the Birdmasters give preference to bugs that are generally classified as low in severity.

What does this mean for testing?

However, let’s think of a few other examples: What if the text isn’t shaped nicely around the picture or if the text is unreadable because it is too small or in the wrong color? If you report a suggestion for change for the existing or new functions to make the application better, it’s called usability issues, which, strictly speaking, are not bugs. And what if you are supposed to test an app in flight mode and various functions no longer work? What about if the app automatically switches to landscape mode? If the design changes? Those things might confuse the tester but are meant to be a “feature”. We call that the Testbirds dilemma: we want our testers to look at software from an unbiased perspective and we also don’t ask our clients for any software specifications. This means that borderline cases can happen, where it is hard to define whether a bug reported by a tester is actually a bug, a feature or a usability issue. One possible way to handle this is to accept the bug report with a low severity and in the cases of a BugAbility™ test the problem should also be mentioned in the usability part of the testing process.

So the number one rule is: no machine in this world can replace human common sense as there will always be exceptions.

Franzi

Bugs made by Freepik from www.flaticon.com is licensed by CC BY 3.0

Share it if you like it:

Tag Cloud

About the author

Franziska Stieglmair

Franziska Stieglmair

PR & Marketing Manager

Franzi is our allround talent: Sie works in Marketing and Project Management. In her free time she prefers good movies and travelling.

Categories

Links

Other content that might be interesting for you:

I’m Maximilian and this is my role at Testbirds

My Role at Testbirds is a series of blog posts that gives insights into the daily life at the office. Every so often, one of our employees will...

How We Became a FOCUS Revenue Growth Champion: A Brief Company History

Testbirds is “FOCUS Wachstumschampion 2018”, which means we are one of 500 companies with the highest revenue growth in Germany! The German news...

World Quality Report: Crowdtesting on the rise

Bigger Testing Budgets This week, Capgemini, HP and Sogeti released the sixth version of their annual World Quality Report. Key findings include...

“Cookie” – The crunchiest term in IT

“Terms from the world of IT explained” is a series of blog posts that explain the origin of common IT terms. We often use them in our daily life,...

What is QA Testing and Why Do We Need It?

Does my software have any bugs or issues? This is probably the most frequently asked question when developing a new product - and if it’s not, then...

Bringing our offline world online – the Internet of Things

More and more connected home devices are becoming part of our everyday lives, whether its controlling your heating from outside your home, turning...

Testbirds Holiday Apps: Stockholm

Ever fancied a trip to Scandinavia? Stockholm, a popular tourist destination for those looking to discover northern Europe, has a bustling big city...

Crowdtesting – A How-To Guide for testing successfully

Over the last couple of years, crowdtesting has become a more and more popular complimentary method to ensuring a high quality of mobile apps,...

One week with my Shine

Last year, I bought myself a Sony Smartwach 2. Obviously, smartwatches haven’t been able to make a breakthrough yet, which is why I’m still getting...

Interesting takeaways from Google I/O 2019

Throughout its existence, Google developed into so much more than just the search provider it initially started out as. I’m sure you’ve all used...

Testbirds specialises in the testing of software such as apps, websites and Internet of Things applications by using innovative technologies and solutions. Under the slogan, “Testing Reality”, the company offers various testing methods to its clients looking to optimise the user-friendliness and functionality of their digital products. With over 250,000 registered testers located in 193 countries, Testbirds is one of the world’s leading crowdtesting providers. In addition, the IT service provider utilises cloud based technologies to support customers in the optimisation of their digital products. The combination of the two testing methods delivers a unique and extensive portfolio that takes the quality of software to the next level. Testbirds was founded in 2011 by Philipp Benkler, Georg Hansbauer and Markus Steinhauser. Today, the company has over 100 employees. Other than its headquarters in Munich, there are now offices in Amsterdam, London and Stockholm, franchises in Hungary and Russia and sales partners in Italy.

© Testbirds GmbH. All rights reserved.

Subscribe to the Testbirds Whistler!

Receive updates on our innovative testing services, webinars, brand-new Nest features!

You have Successfully Subscribed!

@ Contact