Table 6 Agreement among participants, considering only “yes” marked
From: The problem of conceptualization in god class detection: agreement, strategies and decision drivers
Without visualization | With visualization | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
Program | Number of | Raters | Finn | p-value | Agreement | Number of | Raters | Finn | p-value | Agreement |
classes | (participants) | coefficient | classes | (participants) | coefficient | |||||
Monopoly | 10 | 6 | 0.827 | 8.44e-12 | Almost perpect | 10 | 4 | 0.867 | 3.87e-09 | Almost perpect |
Tetris | 16 | 6 | 0.892 | 5.34e-25 | Almost perpect | 16 | 5 | 0.675 | 5.89e-08 | Substantial |
Tic Tac Toe | 5 | 6 | 0.653 | 0.00102 | Substantial | 5 | 5 | 0.84 | 7.14e-06 | Almost perpect |
Chess | 15 | 5 | 0.787 | 1.21e-11 | Substantial | 15 | 6 | 0.84 | 5.26e-18 | Almost perpect |
Jackut | 19 | 4 | 0.842 | 3.31e-14 | Almost perfect | 19 | 6 | 0.895 | 6.683-30 | Almost perpect |
Solitaire | 23 | 5 | 0.896 | 3.62e-29 | Almost perfect | 23 | 5 | 0.843 | 4.38e-22 | Almost perpect |