Skip to main content

Table 5 Agreement among participants, considering “yes” or “maybe” marked

From: The problem of conceptualization in god class detection: agreement, strategies and decision drivers

 

Without visualization

With visualization

Program

Number of

Raters

Finn

p-value

Agreement

Number of

Raters

Finn

p-value

Agreement

 

classes

(participants)

coefficient

  

classes

(participants)

coefficient

  

Monopoly

10

6

0.507

0.000996

Moderate

10

4

0.7

7.37e-05

Substantial

Tetris

16

6

0.733

5.09e-12

Substantial

16

5

0.8

4.91e-13

Substantial

Tic Tac Toe

5

6

0.6

0.00335

Moderate

5

5

0.2

0.283

Slight

Chess

15

5

0.787

1.21e-11

Substantial

15

6

0.664

4.46e-08

Substantial

Jackut

19

4

0.772

1.73e-10

Substantial

19

6

0.881

1.33e-27

Almost perpect

Solitaire

23

5

0.843

4.38e-22

Almost perfect

23

5

0.843

4.38e-22

Almost perpect