|
Server : Apache/2.4.62 System : FreeBSD fbsdweb2.web.rcn.net 14.1-RELEASE FreeBSD 14.1-RELEASE releng/14.1-n267679-10e31f0946d8 GENERIC amd64 User : www ( 80) PHP Version : 8.3.8 Disable Function : NONE Directory : /domains/srakitin/OLD/newsletter/vol6/no3/ |
Upload File : |
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<title>Food for Thought: Does Anyone Care About Quality?</title>
<link href="/newsletter/StyleSheet.css" rel="stylesheet" type="text/css">
</head>
<OpenTracking/>
<!-- Do NOT delete previous line if you want to get statistics on the number of opened emails -->
<body>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0">
<tr align="center" valign="top">
<td colspan="2"><img src="/newsletter/images/FoodForThoughtLogo.gif" alt="Food for Thought" width="600" height="105"></td>
</tr>
<tr class="Reference">
<td align="left" valign="top"><p>An e-newsletter published by<br>
Software Quality Consulting, Inc. </p>
</td>
<td align="right" valign="top"><p>April 2009 , Vol. 6 No. 3 <br>
[<a href="/newsletter/vol6/no3/vol6no3.txt" target="_blank">Text-only Version</a>]</p>
</td>
</tr>
</table>
<br>
<br>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td align="left" valign="top">
<p>Welcome to <em><strong>Food for Thought™</strong></em>, an e-newsletter from <strong><a href="/index.html?Intro" target="_blank">Software Quality Consulting</a></strong>. I've created free subscriptions for my valued business contacts. If you find this newsletter informative, I encourage you to continue reading. Feel free to pass this newsletter along to colleagues by clicking this <strong><a href="http://ui.constantcontact.com/roving/sa/fp.jsp?plat=i&p=f&m=sctz69n6">Forward Email</a></strong> link. If you’ve received this newsletter from a colleague and would like to subscribe, please click this <strong><a href="/newsletter/Subscribe.htm?Newsletter" target="_blank">Enter New Subscription</a></strong> link. If you don't wish to receive this newsletter, click the <strong><a href="#bottom">SafeUnSubscribe</a></strong>™ link at the bottom of this newsletter, and you won’t be bothered again.</p>
<p>Your continued feedback on this newsletter is most welcome. Please send your comments and suggestions to <strong><a href="mailto:[email protected]">[email protected]</a></strong>.</p></td>
</tr>
</table>
<br>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td width="114" align="right" valign="top" background="/newsletter/images/RedSpacer.gif"><img src="/newsletter/images/InThisIssue.gif" alt="In This Issue" width="114" height="37"></td>
<td width="15"> </td>
<td align="left" valign="top"><p>In <a href="#article"><strong>This Months’ Topic</strong></a>, I discuss the importance of delivering a quality product...<br>
<br>
Regular features to look for each month are:</p>
<ul>
<li> <a href="#morsel"><strong>Monthly Morsels</strong></a><br>
Hints, tips, techniques and reference info related to this month’s topic</li>
</ul>
<ul>
<li> <a href="#calendar"><strong>Calendar</strong></a><br>
Conferences, workshops, and meetings of interest to software engineers, QA engineers and anyone interested in software development</li>
</ul>
</td>
</tr>
</table>
<br>
<br>
<a name="article"></a>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td width="114" align="left" valign="top" background="/newsletter/images/RedSpacer.gif"><img src="/newsletter/images/ThisMonthsTopic.gif" alt="This Month's Topic" width="114" height="37"></td>
<td width="15"> </td>
<td width="471" align="left" valign="top" class="BodyText"><p align="center" class="Headline"> <strong> Does Anyone Care About Quality?</strong> </p>
<p> Most consumers care about quality. When consumers buy products and services, there is an expectation of quality. When you go to the pharmacy for a cold remedy, you expect the product you buy will help you feel better, not make you sicker. When you buy a new car, you expect it will work as advertised, not stall on the highway. If you need technical support for say, a new laptop, you expect the support person will actually help you solve your problem, not give you a run-around.</p>
<p> For some reason, our expectations for software are much lower than for any other product. When we buy software, we expect it will be buggy. We seem to be resigned to the fact that software will have problems and there is nothing we can do about it.<br>
<br>
</p>
</td>
</tr>
<tr>
<td align="left" valign="top" background="/newsletter/images/RedSpacer.gif"><img width="110" height="82" src="/newsletter/vol6/no3/vol6no3_clip_image002_0000.jpg"> </td>
<td> </td>
<td align="left" valign="top" class="BodyText"><blockquote>
<p>“...there’s ultimately one reason software companies keep selling buggy software. <em>Because we let them</em>.” [1]</p>
</blockquote>
<p> The issue I would like to discuss this month is - does anyone care about quality?</p>
<p><strong> Does your company have a reputation for quality?</strong></p>
<p> Some companies are known for delivering quality products. Companies like H-P and Motorola are two examples of large companies known for producing consistently high quality software products. By working hard at integrating a quality culture into all aspects of software product development, these companies have earned the respect and the loyalty of many consumers. These companies have made a considerable investment in quality. The return on this investment is fiercely loyal customers. What could be better than that?</p>
<p> However, once a company’s quality reputation becomes tarnished, customers will choose someone else and it is often extremely difficult to win those customers back. You need only look at what’s left of the US auto industry to see firsthand evidence of this. A recent article in the Wall Street Journal stated that:</p>
<blockquote>
<p> “A perception of inferior quality is the most serious problem facing GM, aside from its financial predicament” [2]</p>
</blockquote>
<p> Even though independent organizations such as Consumer Reports have given GM cars such as the Chevy Malibu high marks for quality, the perception is that many American made cars don’t compare to European and Asian cars with regard to quality and reliability. Having owned a Malibu back when it suffered from poor quality, I swore I would never buy another one.</p>
<p> Japanese automakers showed the world it was possible to build high quality cars for a reasonable price. The CEO of Ford, a huge fan of Toyota’s legendary quality practices, is trying to do for Ford what Toyota has done for the rest of the auto industry - instill a quality culture. Like GM, Ford’s reputation has been tarnished...</p>
<blockquote>
<p> In the 1970’s, Ford chose to ignore a lethal defect in the Pinto. This was as an example of corporate arrogance and disregard for consumers. This decision demonstrated that Ford did not care about quality or safety.</p>
</blockquote>
<ul>
<li>Read more about the<strong> <a href="http://en.wikipedia.org/wiki/Ford_Pinto#Safety_problems" target="_blank">Ford Pinto’s safety problems...</a></strong></li>
</ul>
<p> Now how does all this relate to software? Several people have observed that there are striking similarities between the arrogance that typified the US automakers for several decades and the software industry. Think about it - what other industry routinely produces defective products, is aware of many of these defects, chooses to not fix them, and then has the audacity to charge customers for fixing these defects!</p>
<p> How did we get here? Software marketing people have long believed that quality does not sell and that only new features sell. If that were true, then:</p>
<ul>
<li> Why is <strong>Google Search</strong> - which ostensibly has only one feature - the most popular search engine in the world? </li>
</ul>
<ul>
<li> Why have so many PC users refused to migrate to Vista? There’s lots of new features in Vista but many of these people have finally realized that <strong>we don’t need all those new features - we need stability and quality! </strong></li>
</ul>
<p> A recent article in <em>InformationWeek</em> magazine reported that:</p>
<blockquote>
<p> “Of the sites monitoring software quality in <em>InformationWeek</em> Research’s Software Quality survey, 82% say they have avoided using a vendor because of a reputation for poor-quality code.” [5]</p>
</blockquote>
<p align="center"><img width="298" height="225" src="/newsletter/vol6/no3/vol6no3_clip_image001.gif"></p>
<blockquote>
<p>“More than three-quarters of the 198 companies in <em>InformationWeek's</em> survey monitoring the performance of their software apps say that software quality is a significant consideration when choosing a software vendor, and just one in five considers it a minor matter. Only 3% report that software quality isn't a factor when selecting a software vendor.” [5]</p>
</blockquote>
<p align="center"><img width="318" height="266" src="/newsletter/vol6/no3/vol6no3_clip_image002.gif"></p>
<p> In the current economy, I believe software companies who deliver lower quality products and services - whether intentionally or unintentionally - will be in worse shape when the recession ends than those who do deliver better quality products and services.</p>
<p><strong> Why Care About Software Quality?</strong></p>
<p> We need to care about software quality because software is finding its way into more and more aspects of routine daily life...</p>
<blockquote>
<p> “Software is pervasive in modern society, but we are often unaware of its presence until problems arise. Software is one ofthe most important and yet one of the most economically challenging technologies of the current era. As a purely intellectual product, it is among the most labor intensive, complex, and error-prone technologies in human history. Even though many successful software products and systems exist in the world today, an overall lack of attention to quality has also led to many problematic systems that do not work right as well as to many software projects that are late, over budget, or canceled.” [3] </p>
</blockquote>
<p> A recent study by the US National Institute of Science and Technology (NIST) [6] estimated that software defects cost the US economy almost $60 billion a year. Given the increasing trends in application complexity, this number is certainly likely to increase… </p>
<p> So why does it seem that customers don’t care about software quality? Well, as Watts Humphrey observed: </p>
<p align="center"><strong> “Because defective software works.”</strong> [7] </p>
<p> It may not work in every situation or for every user, but it usually works as long as users stay within defined use models. These defined use models represent the <strong>best guess</strong> of developers and testers as to how users will use the software. Watts Humphrey calls these defined use models the “testing footprint” [7] as shown below. </p>
<p><img width="471" height="281" src="/newsletter/vol6/no3/vol6no3_clip_image003.jpg"></p>
<p><strong> How can we develop high quality software when we know that zero-defects is not possible?</strong></p>
<p> Given the exponential increase in complexity, everyone should understand that releasing software with zero-defects is not practical and not possible.</p>
<ul>
<li> To understand why, read more about <strong><a href="/newsletter/vol2/no11/vol2no11.html" target="_blank">defective software...</a></strong></li>
</ul>
<p> So what can we do? Well, understanding your customer’s testing footprint is very similar to a testing strategy I call - <strong>Act Like a Customer Testing.</strong> TM Test teams who use <strong>Act Like a Customer Testing</strong> TM often find that there are far fewer defects reported by customers. That doesn’t mean there aren’t defects in the software, but rather, your customers are not finding them.</p>
<p align="center"><img width="471" height="208" src="/newsletter/vol6/no3/vol6no3_clip_image004.gif"></p>
<p> To incorporate this strategy into your testing, testers need <strong><a href="/newsletter/vol2/no9/vol2no9.html" target="_blank">domain knowledge</a></strong>. Armed with domain knowledge, testers can put themselves in their customer’s shoes and do what customers do. This helps find the most important defects - the ones your customers would find... </p>
<ul>
<li> Read more about <strong><a href="/newsletter/vol2/no4/vol2no4.html" target="_blank"> Act Like A Customer Testing™…</a></strong></li>
</ul>
<p><strong> A Measure of Quality</strong></p>
<p> How can you tell how good a job you are doing at Acting Like a Customer in your testing? The most straightforward way is a simple metric developed by Capers Jones, called <strong>Defect Removal Efficiency</strong>. [4]</p>
<ul>
<li> Read more about <strong><a href="/newsletter/vol2/no9/Capers.pdf" target="_blank">defect-removal efficiency metric…</a><br>
</strong></li>
</ul></td>
</tr>
<tr>
<td align="left" valign="top" background="/newsletter/images/RedSpacer.gif"><img width="110" height="148" src="/newsletter/vol6/no3/vol6no3_clip_image002.jpg"> </td>
<td> </td>
<td align="left" valign="top" class="BodyText"><p>Simply count the number of defects found during your normal development and testing process and then divide that by that same number PLUS those defects reported by customers during some predefined usage period... </p>
<p align="center"><strong>Total defects we find</strong><br>
<img width="247" height="2" src="vol6no3_clip_image005.gif"><br>
<strong>Total we find + Customer-reported defects</strong></p>
<p> Most shrink-wrap software has a Defect Removal Efficiency of between 70-80%. Best-in-class companies such as H-P and Motorola typically have defect removal efficiencies of 99.5% or higher. The higher the defect removal efficiency metric, the better your test cases are at finding those defects that customers are likely to find. </p>
<p><strong> The Bottom Line....</strong></p>
<p> Help your organization adopt a quality culture by developing a vocabulary for talking about quality in the context of your products and from the perspective of your customers. Once you have this vocabulary, derive a few simple measures - Defect Removal Efficiency is a good example. From these few measures, management can then begin to make better business decisions and your customers will thank you with their loyalty...</p>
‘Til next time...</td>
</tr>
</table>
<br>
<br>
<a name="morsel"></a>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td width="114" align="right" valign="top" background="/newsletter/images/RedSpacer.gif"><img src="/newsletter/images/MonthlyMorsels.gif" alt="Monthly Morsels" width="114" height="37"></td>
<td width="15"> </td>
<td align="left" valign="top"><p> Every month in this space, you’ll find additional information related to this month’s topic.</p>
<p><strong> References</strong></p>
<ol>
<li> Minasi, M., <em>Software Conspiracy: Why Companies Put Out Faulty Software, How They Can Hurt You and What You Can Do About It,</em> McGraw-Hill, 1999. <br>
<br>
</li>
<li> Helliker, K., and Stoll, J., “Malibu Shows Road to Recovery Is Bumpy”, <em>Wall Street Journal</em>, April 1, 2009.<br>
<br>
</li>
<li> Krasner, H. “Using the Cost of Quality Approach for Software”, <em>CrossTalk</em>, November, 1998. <br>
<br>
</li>
<li> Jones, C., “Software Defect Removal Efficiency”, <em>IEEE Computer</em>, April 1996. <br>
<br>
</li>
<li> Weier, M. H. , “Consortium Confronts Software-Quality Issues”,<br>
<a href="http://www.informationweek.com/;jsessionid=W1JGSI2MKDC3WQSNDLRSKHSCJUNN2JVN" target="_blank"><em><strong> InformationWeek</strong></em></a>, May 26, 2003.<br>
<br>
</li>
<li>“The Economic Impacts of Inadequate Infrastructure for Software Testing”, <em>NIST Planning Report</em> 02-3, May 2002.<br>
<br>
</li>
<li> Humphrey, W., “<strong><a href="http://www.sei.cmu.edu/news-at-sei/columns/watts_new/2004/1/watts-new-2004-1.htm" target="_blank">Defective Software Works</a></strong>”, <em>news@sei newsletter</em>, Number 1, 2004. </li>
</ol></td>
</tr>
</table>
<br>
<br>
<a name="calendar"></a>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td width="114" align="right" valign="top" background="/newsletter/images/RedSpacer.gif"><img src="/newsletter/images/Calendar.gif" alt="Calendar" width="114" height="37"></td>
<td width="15"> </td>
<td align="left" valign="top"><p> Every month you’ll find news here about local and national events that are of interest to the software community…</p>
<ul>
<li><strong> Software Quality Calendar</strong></li>
</ul>
<blockquote>
<p>There are many organizations that sponsor monthly meetings, workshops, and conferences of interest to software professionals. <strong><a href="/links/upcoming.html" target="_blank">Find out what’s happening…</a></strong></p>
</blockquote>
<ul>
<li><strong> Workshops Offered by Software Quality Consulting</strong></li>
</ul>
<blockquote>
<p>Software Quality Consulting offers workshops in many topics related to software process improvement. <strong><a href="/seminars/courses.html" target="_blank">Get more info…</a></strong></p>
</blockquote></td>
</tr>
</table>
<br>
<br>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td width="114" align="right" valign="top" background="/newsletter/images/RedSpacer.gif"><img src="/newsletter/images/AboutSQC.gif" alt="About SQC" width="114" height="37"></td>
<td width="15"> </td>
<td align="left" valign="top"><p> Software Quality Consulting provides consulting, training, and auditing services tailored to meet the specific needs of clients. We help clients fine-tune their software development processes and improve the quality of their software products. The overall goal is to help clients achieve Predictable Software Development™ – so that organizations can consistently deliver quality software with promised features in the promised timeframe. </p>
To learn more about how we can help your organization, <strong><a href="/index.html?AboutSQC" target="_blank">visit our web site</a></strong> or <strong><a href="mailto:[email protected]">send us an email</a></strong>.</td>
</tr>
</table>
<br>
<br>
<table width="600" border="0" align="center" cellpadding="0" cellspacing="0" class="BodyText">
<tr>
<td align="left" valign="top"><p> I hope this newsletter has been informative and helpful. Your comments and feedback are most welcome. <strong><a href="mailto:[email protected]">Send me your feedback…</a></strong></p>
<p>Thanks,</p>
<p> <img src="/newsletter/images/BusinessCard.gif" width="270" height="121" align="right"><img src="/newsletter/images/Signature.gif" width="90" height="68"><br>
Steve Rakitin<br>
<br>
<strong><a href="mailto:[email protected]">[email protected]</a></strong></p></td>
</tr>
</table>
<div align="center"><br>
<FONT class="Reference">Food for Thought, Predictable Software Development, Act Like a Customer,<br>
and ALAC are trademarks of Software Quality Consulting, Inc.<br>
Copyright 2009. Software Quality Consulting, Inc. All rights reserved.<br>
Graphic design by <a href="http://www.sarahcoledesign.com/" target="_blank"><strong>Sarah Cole Design</strong></a>.</FONT></div>
<a name="bottom"> </a></body>
</html>