Table 8 Incremental strategy for applying bug kinds
From: Correlating automatic static analysis and mutation testing: towards incremental strategies
# | W | Cassadra | Apache POI | Hibernate | Total | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
W C | CC C | CR C | W P | CC P | CR P | W H | CC H | CR H | W total | CC total | CR total | ||
1 | QF | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % |
2 | RE | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % | 3 | 3 | 99.86 % | 3 | 3 | 99.92 % |
3 | UM | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % | 0 | 3 | 99.86 % | 0 | 3 | 99.92 % |
4 | QBA | 0 | 0 | 100.00 % | 0 | 0 | 100.00 % | 0 | 3 | 99.86 % | 0 | 3 | 99.92 % |
5 | INT | 2 | 2 | 99.79 % | 3 | 3 | 99.61 % | 0 | 3 | 99.86 % | 5 | 8 | 99.79 % |
6 | BIT | 0 | 2 | 99.79 % | 4 | 7 | 99.10 % | 0 | 3 | 99.86 % | 4 | 12 | 99.69 % |
7 | UR | 0 | 2 | 99.79 % | 3 | 10 | 98.71 % | 4 | 7 | 99.67 % | 7 | 19 | 99.51 % |
8 | UCF | 0 | 2 | 99.79 % | 5 | 15 | 98.07 % | 13 | 20 | 99.06 % | 18 | 37 | 99.04 % |
9 | SA | 1 | 3 | 99.68 % | 0 | 15 | 98.07 % | 0 | 20 | 99.06 % | 1 | 38 | 99.01 % |
10 | IL | 0 | 3 | 99.68 % | 1 | 16 | 97.94 % | 1 | 21 | 99.01 % | 2 | 40 | 98.96 % |
11 | DLS | 5 | 8 | 99.15 % | 26 | 42 | 94.59 % | 392 | 413 | 80.62 % | 423 | 463 | 87.98 % |
12 | SS | 0 | 8 | 99.15 % | 0 | 42 | 94.59 % | 1 | 414 | 80.57 % | 1 | 464 | 87.96 % |
13 | BSHIFT | 0 | 8 | 99.15 % | 0 | 42 | 94.59 % | 0 | 414 | 80.57 % | 0 | 464 | 87.96 % |
14 | DB | 4 | 12 | 98.73 % | 2 | 44 | 94.33 % | 3 | 417 | 80.43 % | 9 | 473 | 87.72 % |
15 | RpC | 0 | 12 | 98.73 % | 1 | 45 | 94.20 % | 1 | 418 | 80.38 % | 2 | 475 | 87.67 % |
16 | NP | 64 | 76 | 91.97 % | 7 | 52 | 93.30 % | 90 | 508 | 76.16 % | 161 | 636 | 83.49 % |
17 | DMI | 1 | 77 | 91.86 % | 0 | 52 | 93.30 % | 1 | 509 | 76.11 % | 2 | 638 | 83.44 % |
18 | UwF | 12 | 89 | 90.59 % | 3 | 55 | 92.91 % | 41 | 550 | 74.19 % | 56 | 694 | 81.99 % |
19 | BC | 49 | 138 | 85.41 % | 92 | 147 | 81.06 % | 86 | 636 | 70.15 % | 227 | 921 | 76.10 % |
20 | MS | 29 | 167 | 82.35 % | 71 | 218 | 71.91 % | 30 | 666 | 68.75 % | 130 | 1,051 | 72.72 % |
⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ | ⋯ |
61 | Nm | 6 | 551 | 41.75 % | 28 | 701 | 9.66 % | 18 | 1260 | 40.87 % | 52 | 2512 | 34.80 % |
62 | ODR | 0 | 551 | 41.75 % | 0 | 701 | 9.66 % | 2 | 1262 | 40.78 % | 2 | 2514 | 34.75 % |
63 | PZLA | 5 | 556 | 41.23 % | 8 | 709 | 8.63 % | 54 | 1316 | 38.24 % | 67 | 2581 | 33.01 % |
64 | RC | 0 | 556 | 41.23 % | 0 | 709 | 8.63 % | 1 | 1317 | 38.20 % | 1 | 2582 | 32.99 % |
65 | RI | 3 | 559 | 40.91 % | 0 | 709 | 8.63 % | 28 | 1345 | 36.88 % | 31 | 2613 | 32.18 % |
66 | RR | 0 | 559 | 40.91 % | 8 | 717 | 7.60 % | 0 | 1345 | 36.88 % | 8 | 2621 | 31.98 % |
67 | SC | 4 | 563 | 40.49 % | 0 | 717 | 7.60 % | 0 | 1345 | 36.88 % | 4 | 2625 | 31.87 % |
68 | SF | 143 | 706 | 25.37 % | 26 | 743 | 4.25 % | 4 | 1349 | 36.70 % | 173 | 2798 | 27.38 % |
69 | SIC | 164 | 870 | 8.03 % | 10 | 753 | 2.96 % | 99 | 1448 | 32.05 % | 273 | 3071 | 20.30 % |
70 | STCAL | 2 | 872 | 7.82 % | 0 | 753 | 2.96 % | 0 | 1448 | 32.05 % | 2 | 3073 | 20.24 % |
71 | Se | 48 | 920 | 2.75 % | 3 | 756 | 2.58 % | 106 | 1554 | 27.08 % | 157 | 3230 | 16.17 % |
72 | SnVI | 9 | 929 | 1.80 % | 9 | 765 | 1.42 % | 551 | 2105 | 1.22 % | 569 | 3799 | 1.40 % |
73 | UL | 0 | 929 | 1.80 % | 0 | 765 | 1.42 % | 1 | 2106 | 1.17 % | 1 | 3800 | 1.38 % |
74 | UPM | 6 | 935 | 1.16 % | 1 | 766 | 1.29 % | 13 | 2119 | 0.56 % | 20 | 3820 | 0.86 % |
75 | USELESS_STRING | 0 | 935 | 1.16 % | 9 | 775 | 0.13 % | 2 | 2,121 | 0.47 % | 11 | 3831 | 0.57 % |
76 | UuF | 1 | 936 | 1.06 % | 0 | 775 | 0.13 % | 2 | 2123 | 0.38 % | 3 | 3834 | 0.49 % |
77 | VO | 4 | 940 | 0.63 % | 0 | 775 | 0.13 % | 2 | 2125 | 0.28 % | 6 | 3840 | 0.34 % |
78 | WMI | 4 | 944 | 0.21 % | 1 | 776 | 0.00 % | 6 | 2131 | 0.00 % | 11 | 3851 | 0.05 % |
79 | Wa | 2 | 946 | 0.00 % | 0 | 776 | 0.00 % | 0 | 2131 | 0.00 % | 2 | 3853 | 0.00 % |
80 | Sum | 946 | − | − | 776 | − | − | 2131 | − | − | 3853 | − | − |