Skip to main content

Table 15 Finn agreement test for FinG 1 and FinG 2 experiments

From: Investigating factors that affect the human perception on god class detection: an analysis based on a family of four controlled experiments

Program

Experiment

#class

#part

Finn

p-value

Agreement level

Monopoly

FinG 1

4

11

0.636

7.4e-05

Substantial

 

FinG 2

8

25

0.732

2.51e-26

Substantial

 

Evolution of agreement level from FinG 1 to FinG 2

 

SAME

Tetris

FinG 1

8

11

0.682

8.12e-10

Substantial

 

FinG 2

10

25

0.78

2.56e-40

Substantial

 

Evolution of agreement level from FinG 1 to FinG 2

 

SAME

Tic Tac Toe

FinG 1

4

11

0.691

7.94e-06

Substantial

 

FinG 2

5

24

0.713

3.12e-15

Substantial

 

Evolution of agreement level from FinG 1 to FinG 2

 

SAME

Chess

FinG 1

10

11

0.716

1.22e-13

Substantial

 

FinG 2

10

25

0.803

8.14e-45

Almost perfect

 

Evolution of agreement level from FinG 1 to FinG 2

 

INCR

Jackut

FinG 1

8

10

0.722

1.67e-10

Substantial

 

FinG 2

6

25

0.66

5.65e-15

Substantial

 

Evolution of agreement level from FinG 1 to FinG 2

 

SAME

Solitaire

FinG 1

10

11

0.702

7.3e-13

Substantial

 

FinG 2

6

25

0.649

2.61e-14

Substantial

 

Evolution of agreement level from FinG 1 to FinG 2

 

SAME