From: Investigating measures for applying statistical process control in software organizations
Measures | Publications | Processes | Goals |
---|---|---|---|
aDefect injection distribution (by Requirements Development, Design, Coding, and Testing)(defects injected in requirements (or design, coding and testing) / all defects removed in system testing * 100%) | P16 | Coding, Design, Requirements Development, Testing | G07 |
aDefect removal effectiveness (by Requirements Development, Design, Coding, and Testing)(number of removed defects in requirements (or design, coding and testing) /number of detected defects) | P16,P43 | Coding, Design, Requirements Development, Testing | G04.4 |
aDefect injection rate (by Requirements Development, Design, Coding, and Testing)(number of injected defects/number of removed detected defects) | P06,P15,P16,P40,P43,P49 | Coding, Design, Requirements Development, Testing, Review | G08.1;G08.3;G05.5;G05.7;G05.9;G15 |
bDefects detection rate per Inspection (number of detected defects/number of performed inspections) | P46 | Review | – |
bInspection effectiveness (number of detected defects in inspections/number of delivered defects) | P26,P47 | Review | – |
aInspection rate (inspected product size/ time spent on the inspection) | P18,P21,P26,P32,P37,P40,P41,P42 | Review | G04.1;G05.1;G05.2;G04.3;G06.1 |
aPercentage of defects caused by faulty logic (number of defects caused by faulty logic /total number of detected defects *100) | P04 | Review, Testing | G09.1;G05.4; G09 |
aPercentage of defects found in operation (number of defects found in operation/total number of detected defects *100) | P04 | Review, Testing | G09.1;G05.4;G09 |
aPercentage of high severity defects detected in production (number of high severity defects detected in production /total number of detected defects *100) | P04 | Review, Testing | G09.1;G05.4;G09 |
aPercentage of high severity defects identified in testing (number of high severity defects identified in testing/total number of detected defects *100) | P04 | Review, Testing | G09.1;G05.4;G09 |
aPercentage of rejected defects (number of rejected defects/total number of detected defects *100) | P04 | Review, Testing | G09.1;G05.4;G09 |
aRework percentage (rework effort/total effort *100) | P03,P07,P11,P28 | Requirements Analysis, Design, Coding, and Testing | G09.2;G10 |
bCompleted task non-conformance density (number of completed tasks/ number of defects of all completed tasks) | P20 | Requirements Analysis, Design, Coding, and Testing | G05 |
bExpected task non-conformance density (number of tasks expected to be completed/ number of defects of all tasks) | P20 | Requirements Analysis, Design, Coding, and Testing | G05 |
aRequirements change rate (number of changed requirements /total number of requirements) | P23 | Requirements Management | G05.8 |
aDefect density (number of detected defects/product size) | P02,P05,P07,P11,P13,P15,P16,P18,P19,P20,P21,P23,P24,P26,P28,P30,P31,P32,P33,P34,P35,P36,P37,P38,P40,P42,P43,P44,P45,P46,P48,P49,P50 | Review, Coding, Maintenance, Requirements Analysis, Design, Testing | G02;G05.1;G08.4;G03;G05;G04.3;G04;G05.6;G10;G05.9;G05.10;G04.2;G15 |
aReview Efficiency (number of detected defects/ effort spent on the review) | P24 | Review | G04.3 |
aReview effectiveness (number of defects detected in reviews/total number of defects) | P24,P44 | Review | G04.3 |
Review preparation rate (size of the product to be reviewed/time spent to prepare the review) | P43 | Review | G06 |
Review rate (size of the reviewed product/ time spent on the review) | P43 | Review | G06 |
aNon-conformance density in system test (number of non-conformances in system tests found by verification and validation/number of system tests reviewed by verification and validation) | P07 | Testing | G10.5 |
aDensity of defect in test (number of defects detected in test/ number of test cases reviewed) | P07,P09,P17 | Testing | G13 |
aDelivered defect density (defects detected after product release / product size) | P16,P43,P50 | Testing | G05;G05.1 |
aSystem test effectiveness (number of defects detected in system test / total number of detected defects) | P07 | Testing | G10.5 |
aSystem test verification and validation effectiveness (number defects found in system test by review / number of defects found in system test by all sources) | P07 | Testing | G10.5 |
aTest efficiency (number of defects detected in tests/ number of defects detected in tests + delivered defects) | P16,P50 | Testing | G08.4 |
aTest non-conformance density (number of non-conformance in test found by verification and validation /number of tests reviewed by verification and validation) | P07 | Testing | G10;G10.5 |
aTest verification and validation effectiveness (number of defects found in test by review/ total number of defects in test found by all sources) | P07 | Testing | G10.5 |
aUnit test effectiveness (number of defects detected in unit test / total number of defects) | P07,P26 | Testing | G10;G14 |
aUnit test verification and validation effectiveness (number of defects in unit tests found by review/number of defects in unit tests found by all sources) | P07 | Testing | G10 |
bMean time between failures | P01 | Testing | G05.3 |
Test effectiveness (number of defects detected in tests / total number of detected defects) | P43 | Testing | – |