Infosys

Introduction to Defect Prevention

September, 2011

INFOSYS TECHNOLOGIES LIMITED Mexico

Internal

2010 Infosys Technologies Limited, India

COPYRIGHT NOTICE 2010 Infosys Technologies Limited, Bangalore, India. All rights reserved. Infosys believes the
information in this document is accurate as of its publication date; such information is subject to change without notice. Infosys acknowledges the proprietary rights of other companies to the trademarks, product names and such other intellectual property rights mentioned in this document. Except as expressly permitted, neither this document nor any part of it may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, printing, photocopying, recording or otherwise, without the prior permission of Infosys Technologies Limited and/or any named intellectual property rights holders under this document.

Infosys Technologies Limited Hosur Road Electronic City, 3rd Cross Bangalore 560 100 India. Telephone: (91) (80)28520 261-270 Fax: (91) (80) 8520 362 Website: http://www.infosys.com

Internal

2010 Infosys Technologies Limited, India

Authors
Tania Flores Deyanira Araujo Ernesto Cantu Isaias Varela
Date written (Sep/29/2011):

Internal

2010 Infosys Technologies Limited, India

Target Readers, Keywords and Purpose

Target Readers Defect Prevention Anchors and Backups, Project Managers and DP team.

Keywords Defect Prevention, Types of Defects, DP Plan, Peer Reviews, Verification and Validation, DP Anchor and Team responsibilities.

Purpose of the Document This document provides an Introduction about DP definitions, advantages, DP process, DP Cycle and responsibilities for each role and involves related topics as V&V, Peer-Reviews and the usage of IPM+ for defect tracking.

Internal

2010 Infosys Technologies Limited, India

Defect Prevention

Defect-free software does not exist.

- Wietse Venema

Internal

2010 Infosys Technologies Limited, India

Agenda
Defect Definition Types of Defects Common Fallacies in all Projects Cost of not identifying Defects DP Definition and Advantages Defect Prevention Purpose Validation and Verification Verification Examples Validation Examples Defect Prevention Process Defect Prevention Cycle Defect Prevention Plan Data needed for DP Defect tracking at IPM+ How to diagnose the process and reduce defects Most Common Problems Faced by DP Team DP Project Anchor Responsibilities DP Team Responsibilities References

Internal

2010 Infosys Technologies Limited, India

Defect Definition

What is a Defect?
A defect can be termed as a flaw or discrepancy in any deliverable which includes planning documents, estimations, requirement analysis, design documents, lines of code or test cases.

Internal

2010 Infosys Technologies Limited, India

Types of Defects
The following are just some of the most common types of defects:
Standards: User Interface: Design: Logic: Performance: Portability: Reusability: Traceability: Planning: Memory Management: Unclear Requirements: Incomplete Test Case :
Coding standards, modularity, hard coding, indentation, alignment, layout, comments, misspelling coding Field length, quality of images, typos, security, mismatch of interfaces, user-friendly. Functionality missed, test case missed, wrong test case, redundant/repeated test case, improper algorithm. Wrong interpretation of specs/requirements Server response time, render response time, performance specifications requirements, concurrency/throughput, timing. Matching applications to environments, program libraries, minimum memory capacity; multitasking for background calculations; interactive mode; a guaranteed floating point accuracy; etc Application frameworks, component-bases development, program libraries. Defects in product documentation requirements of corresponding design of artifacts, code, and test cases and in traceability matrix Defects in project plan document, lack of understanding of project management tools, wrong assumptions, errors in definition of cost, time, and high level resources (people, hardware and software) Physical organization, logical organization, protection, relocation, sharing, virtual memory, dynamic memory allocation, garbage collector and paging.

When the requirement itself is ambiguous

When test cases in the test plan are not sufficient to test the code/modification.

Internal

2010 Infosys Technologies Limited, India

Common Fallacies in all Projects

All the defects that we get are cosmetic ones.

In our Project we don't have any defects.

In our process there are so many causes of defects that it is practically impossible to track them.

Internal

2010 Infosys Technologies Limited, India

Cost of not identifying defects

Early detection of defects reduces cost of fixing a defect

80-100 X

Cost

1X Requirements

10-20 X

Design

Code

Unit Test

QA Test

Release

World class benchmark: Defect removal efficiency of 70-90% before QA Test

Internal

2010 Infosys Technologies Limited, India

10

DP Definition and Advantages

Defect Prevention Can be defined as the systematic way of analyzing defects to determine the root cause and taking required action to prevent it from occurring in the future.

DP Advantages
1. Better Quality of deliverables and programmer productivity. 2. Reduce review and rework effort.

Defect Detection (early stage)

1. Reduce costs since defects caught in early stages are cheaper to fix
2. Reduce schedule since rework will be less.

3. Better understanding of issues by team members.

Internal

2010 Infosys Technologies Limited, India

11

Defect Prevention Purpose

Reduce Defects

Reduce Rework

Less Effort Spent

High Quality and Productivity

Internal

2010 Infosys Technologies Limited, India

12

Verification and Validation

Verification Ensures that the system complies with an organization standards and process. Did we build the right system?

Validation

Physically ensures that the system operates according to plan by executing the system function through a series of test that can be observed and evaluated. Did we build the system right?
*Note: The verification and validation techniques can be applied to every element of the system.

Verification

Standards and process of design, requirements, code, test etc.

Find defects before building the system

Defect Preventio n Process

Validation

To execute a real life function

Internal

2010 Infosys Technologies Limited, India

13

Verification Examples

Verification Examples Requirements Reviews

Explanation The study of discussion of the system requirements to ensure they meet stated user needs and are feasible. The study of discussion of the system design to ensure it will support the system requirements. An informal analysis of the program source code to find defects and verify coding techniques

Design Reviews

Code Walkthroughs

Code Inspections

A formal analysis of the program source code to find defects as defined by meeting system specifications.

Internal

2010 Infosys Technologies Limited, India

14

Validation Examples

Validation Examples

Explanation

Unit Testing

The testing of a single program, module of unit of code. The testing of related programs, modules of units of code. Validates the multiple parts of the system interact according to the system design.
The testing of an entire system. It can include functional and structural testing (White Box Testing ). It is a process to obtain confirmation that a system meets mutually agreed-upon requirements. A Subject Matter Expert (SME), preferably the owner or client of the object under test, provides such confirmation after trial or review. In software development, UAT is one of the final stages of a project and often occurs before a client or customer accepts the new system.
2010 Infosys Technologies Limited, India
15

Integrated Testing

System Testing

User Acceptance Testing

Internal

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

Internal

2010 Infosys Technologies Limited, India

16

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

1. Identify Work Product The DP anchor will identify the items that will be reviewed for the project. Reviews can either be Peer-Review or Self-Review. Any clients deliverable should be reviewed.

Internal

2010 Infosys Technologies Limited, India

17

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

2. Identify & execute checklist

A checklist should be identified and executed over every work product. The checklist will contain specific review points that will help you to identify defects in the deliverable.

Internal

2010 Infosys Technologies Limited, India

18

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

3. Track & analyse defects Any defect identified during the review should be tracked.

Internal

2010 Infosys Technologies Limited, India

19

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

4. Identify solution

The DP team will analyse the tracked defects during a Defect Prevention Session or CARs. The output of this meeting is a proposed solution with clear action items and deadlines for completion.
Internal

2010 Infosys Technologies Limited, India

20

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

5. Execute action items The DP team makes sure the identified action items are executed. Following up meetings could be required for this.

Internal

2010 Infosys Technologies Limited, India

21

Defect Prevention Process

Identify & Track & Identify

Identify work product

Execute action items

Validate action items

execute
checklist

analyse
defects

solution

6. Validate action items The DP team validates the efficiency of the executed action items by analyzing a portion of new defects and comparing the defect injection rate between previous and actual.

Internal

2010 Infosys Technologies Limited, India

22

Defect Prevention Cycle

The Defect Prevention is a continuous process. Its a cycle that should be performed during all the SDLC, since the project begins until it ends.
1.- Identify work product

6.- Validate action items

2. Execute checklist

Continuous Defect Prevention

5.- Execute action items 3.- Track & analyse defects

4.- Identify solution

Internal

2010 Infosys Technologies Limited, India

23

Defect Prevention Plan

The Defect Prevention Plan is a long-term plan for defect prevention activities within the project. It contains information like: Objective & Scope Strategy DP Team DP Tools Checklist Planned Schedule Planned Effort

Internal

2010 Infosys Technologies Limited, India

24

Data needed for DP

Type

Configuration, Consistency, Design issues, Documentation,, Incorrect Solution, Logic, Portability, Redundancy, etc.
Severity: Critical, Major, Minor, Cosmetic Priority: High, Medium, Low

Criticality of Defect (Severity, Priority)

Defect Detected stage Defect Injected Stage

Requirement Analysis, HLD, Detailed Design, Build, Project Initiation Ambiguous Specification, Carelessness, Error in Existing Program, Impact Not Analyzed, Improper Setup, Insufficient Time, Lack of Coordination, Lack of Training, etc

Cause

Internal

2010 Infosys Technologies Limited, India

25

Defect Tracking at IPM+

IPM+ allows projects to add reviews to a product, or set of work products, and it is presented to project members or other stakeholders for comment or approval. You can add a review under Tracking > Reviews section.

Internal

2010 Infosys Technologies Limited, India

26

How to diagnose the process and reduce defects

Normally we follow our intuition and previous experience to assess the situation but in the first place what we should use is a Structured way of finding defects and its root cause by analyzing the data we have and then we can go with our previous experience to add value to the analysis.

Internal

2010 Infosys Technologies Limited, India

27

Most Common Problems Faced by DP Team

Defects are:
1. Not logged on time

2. Logged with improper causes

3. Usually caught with cause as "Over Sight" or "Carelessness". This needs to be avoided if possible. 4. Not closed in IPM+ on time (same goes for Reviews).

Internal

2010 Infosys Technologies Limited, India

28

DP Project Anchor Responsibilities

Generate a DP Plan for the project. Identify the work products (deliverables) that will be reviewed as part of V&V process. Identify validation checklists for every deliverable and tailor it if needed. Verify that Peer or Self Reviews are being executed. Verify the checklist identified are executed and is updated if required. Make sure that defects are being tracked at IPM+ Execute Defect Prevention Meetings (CAR sessions) as per defined in the DP Plan. Identify solutions and create/monitor action plan until closure. Provide any DP information at Infosys DP SharePoint sites. Bring awareness of Defect Prevention to the rest of their team. Investigate on DP tools to be implemented in the project. Collect and distribute Lessons Learned and Best Practices for DP across the team .

Internal

2010 Infosys Technologies Limited, India

29

DP Team Responsibilities
Execute peer-reviews and record defects. Utilize effectively the checklists. Make sure data tracked from reviews is accurate. Verify the defects are being tracked in IPM+. Participate actively in the CAR sessions. Suggest actions in the DP session to prevent the occurrence of defects. Execute the action items assigned until closure. Attend any DP meeting/training required. Suggest lessons learned and best practices.

DP team should be well organized and there should be proper assignment of responsibilities to the DP team.

Internal

2010 Infosys Technologies Limited, India

30

References

1. Infosys PRIDE 2. Infosys KSHOP 3. Defect and Problem Prevention Guidelines.doc at PRIDE 4. Defect Prevention Plan template at PRIDE 5. CSQA CBOK 2006 6. chrk09.blogspot.com 7. http://www.famousquotes.com/category/defect / 8. http://en.wikipedia.org/wiki/Wietse_Venema 9. http://www.defectmanagement.com/defectmanagement/dprevention.htm 10.http://www.icspi.com/tutorials-h2007.htm

Internal

2010 Infosys Technologies Limited, India

31

Internal

2010 Infosys Technologies Limited, India