Sorting (Conf, sup, len), Pruning (CM)

BalancedAccuracy

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 106.17, df = 12, p-value < 2.2e-16

c1 Z conf F c3 C S D N c4 A c2 M
3.08 3.62 4.08 4.38 6.9 7 7.03 7.1 8.12 9.65 9.78 9.78 10.5

AUC

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 17.19, df = 12, p-value = 0.1426

F c3 Z C c1 S conf N c4 M D A c2
5.45 5.55 6.03 6.22 6.7 6.7 6.83 7.12 7.38 8.1 8.25 8.3 8.38

GMean

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 24.646, df = 12, p-value = 0.01659

F c3 C N Z c1 conf c4 M S A c2 D
5.28 5.35 5.83 5.88 6.15 6.6 7.2 7.4 7.55 8.25 8.3 8.35 8.88

FScore

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 86.115, df = 12, p-value = 2.778e-13

c1 F Z conf c3 D S C N c4 A c2 M
3.12 4.08 4.08 4.75 6.75 7.2 7.22 7.8 8.4 8.95 9.22 9.22 10.2

Sorting (CM, sup, len), Pruning (CM)

BalancedAccuracy

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 159.96, df = 12, p-value < 2.2e-16

c1 F Z conf S D c3 C N c4 M c2 A
2.88 3.08 3.12 4.35 5.95 6.38 6.42 7.1 8.43 9.55 10.57 11.4 11.78

AUC

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 110.1, df = 12, p-value < 2.2e-16

F S Z c1 c3 conf D C N c4 M c2 A
3.88 4.72 4.72 5.1 5.28 5.78 6.1 6.33 7.35 8.68 10.15 11.2 11.72

GMean

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 75.386, df = 12, p-value = 3.105e-11

F c3 Z c1 conf N C S c4 D M c2 A
3.67 4.92 5.05 5.28 6.1 6.5 6.55 6.92 7.78 7.8 9 10.45 10.97

FScore

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 152.9, df = 12, p-value < 2.2e-16

F c1 Z conf S c3 D C N c4 M c2 A
2.73 3.12 3.62 4.65 5.88 6.28 6.4 7.1 8.12 9.4 10.32 11.47 11.9

Balanced vs imbalanced datasets

Balanced data

Pruning

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 34.145, df = 12, p-value = 0.00064

c1 Z F conf C N c3 S D M A c2 c4
4.05 4.35 4.5 5.95 6.15 6.45 6.5 7.25 8.05 9.15 9.35 9.35 9.9

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 16.887, df = 12, p-value = 0.1539

c3 N C M A c2 c4 F Z S conf c1 D
5.3 5.3 5.5 5.8 6.25 6.4 6.95 7.05 7.45 7.9 8.35 8.9 9.85

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 12.379, df = 12, p-value = 0.4157

F Z C N c1 c3 conf M A c2 c4 S D
5.4 5.9 6.1 6.1 6.3 6.6 6.8 7 7.1 7.1 8 8.75 9.85

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 18.523, df = 12, p-value = 0.1007

c1 F Z c3 conf N S C A c2 D M c4
3.95 5.1 5.15 6.4 6.4 7.35 7.4 7.45 8.1 8.1 8.2 8.5 8.9

Sorting

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 70.503, df = 12, p-value = 2.578e-10

F c1 Z conf c3 S C D N M c4 c2 A
2.95 3.55 3.75 4.9 5.5 6.35 6.7 6.75 7.8 9.2 10.4 11.2 11.95

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 49.711, df = 12, p-value = 1.57e-06

F Z c3 S conf c1 C D N M c4 c2 A
3.55 4.85 4.9 5.45 5.5 5.55 6.3 6.75 7.3 8.65 9.95 10.75 11.5

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 54.478, df = 12, p-value = 2.245e-07

F Z c1 c3 conf C N S M D c4 c2 A
3.15 4.25 4.35 5 5 6 7.3 7.5 8.4 8.7 9.4 10.6 11.35

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 66.827, df = 12, p-value = 1.25e-09

F c1 Z conf c3 S C D N M c4 c2 A
3.05 3.65 4.35 5 5.2 5.85 6.6 7.05 7.7 9.2 10.4 11.1 11.85

Imbalanced data

Pruning

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 87.431, df = 12, p-value = 1.549e-13

c1 conf Z F D S c3 C c4 N A c2 M
2.1 2.2 2.9 4.25 6.15 6.8 7.3 7.85 9.4 9.8 10.2 10.2 11.85

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 44.885, df = 12, p-value = 1.078e-05

F c1 Z conf S c3 D C c4 N A c2 M
3.85 4.5 4.6 5.3 5.5 5.8 6.65 6.95 7.8 8.95 10.35 10.35 10.4

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 21.467, df = 12, p-value = 0.04395

c3 F C N Z c4 c1 conf S D M A c2
4.1 5.15 5.55 5.65 6.4 6.8 6.9 7.6 7.75 7.9 8.1 9.5 9.6

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 85.126, df = 12, p-value = 4.304e-13

c1 Z F conf D S c3 C c4 N A c2 M
2.3 3 3.05 3.1 6.2 7.05 7.1 8.15 9 9.45 10.35 10.35 11.9

Sorting

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 96.799, df = 12, p-value = 2.353e-15

c1 Z F conf S D c3 C c4 N A c2 M
2.2 2.5 3.2 3.8 5.55 6 7.35 7.5 8.7 9.05 11.6 11.6 11.95

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 67.846, df = 12, p-value = 8.085e-10

S F Z c1 D c3 conf C c4 N c2 M A
4 4.2 4.6 4.65 5.45 5.65 6.05 6.35 7.4 7.4 11.65 11.65 11.95

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 31.98, df = 12, p-value = 0.001394

F c3 N Z c4 c1 S D C conf M c2 A
4.2 4.85 5.7 5.85 6.15 6.2 6.35 6.9 7.1 7.2 9.6 10.3 10.6

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 93.273, df = 12, p-value = 1.144e-14

F c1 Z conf D S c3 C c4 N M c2 A
2.4 2.6 2.9 4.3 5.75 5.9 7.35 7.6 8.4 8.55 11.45 11.85 11.95

Binary vs multi-class problems

Binary problems

Pruning

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 35.514, df = 12, p-value = 0.0003876

Z c1 F conf C N c3 D S A c2 M c4
3.83 4.17 4.22 4.78 6.83 6.83 7.11 7.44 7.94 9.11 9.11 9.39 10.22

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 4.3324, df = 12, p-value = 0.9767

M C N F c3 S Z c1 D A c2 c4 conf
6.11 6.22 6.22 6.39 6.44 6.78 6.83 6.94 7.39 7.5 7.67 7.83 8.67

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 13.37, df = 12, p-value = 0.3427

c3 C N M F c1 Z S A c2 c4 D conf
5.44 5.56 5.56 5.67 5.72 6.28 7.06 7.67 8 8 8.33 8.61 9.11

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 22.317, df = 12, p-value = 0.03412

c1 F Z conf c3 D C N A c2 S M c4
4 4.17 4.56 6.33 7 7.17 7.67 7.67 8.11 8.11 8.22 8.78 9.22

Sorting

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 62.872, df = 12, p-value = 6.728e-09

F c1 Z conf c3 S C N D M c4 c2 A
3.28 3.5 3.61 5.22 5.5 6.56 6.67 6.67 6.94 9.72 9.83 11.33 12.17

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 46.251, df = 12, p-value = 6.281e-06

c3 C N S F D c1 Z c4 conf M c2 A
3.28 4.56 4.56 5 5.5 6.5 6.72 6.94 7.94 8.33 9.06 10.89 11.72

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 34.859, df = 12, p-value = 0.0004932

c3 C N F c1 Z S c4 D M conf c2 A
3.5 4.67 4.67 5.28 6 6.78 6.89 7.5 8.06 8.22 8.28 10.17 11

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 59.115, df = 12, p-value = 3.272e-08

F c1 Z c3 conf C N S D M c4 c2 A
2.83 3.5 4.06 5.39 5.89 6.56 6.56 6.89 6.94 9.61 9.72 11.11 11.94

Multiclass problems

Pruning

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 77.715, df = 12, p-value = 1.124e-11

c1 Z conf F S c3 D C c4 N A c2 M
2.18 3.45 3.5 4.5 6.27 6.73 6.82 7.14 9.18 9.18 10.32 10.32 11.41

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 26.607, df = 12, p-value = 0.008797

F c3 conf Z C c1 S c4 N A c2 D M
4.68 4.82 5.32 5.36 6.23 6.5 6.64 7 7.86 8.95 8.95 8.95 9.73

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 22.221, df = 12, p-value = 0.03512

F c3 Z conf C N c4 c1 A c2 S D M
4.91 5.27 5.41 5.64 6.05 6.14 6.64 6.86 8.55 8.64 8.73 9.09 9.09

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 74.118, df = 12, p-value = 5.392e-11

c1 conf Z F S c3 D C c4 N A c2 M
2.41 3.45 3.68 4 6.41 6.55 7.23 7.91 8.73 9 10.14 10.14 11.36

Sorting

BalancedAccuracy

Friedman rank sum test

data: averages Friedman chi-squared = 104.91, df = 12, p-value < 2.2e-16

c1 Z F conf S D c3 C c4 N M A c2
2.36 2.73 2.91 3.64 5.45 5.91 7.18 7.45 9.32 9.86 11.27 11.45 11.45

AUC

Friedman rank sum test

data: averages Friedman chi-squared = 100.72, df = 12, p-value = 4.018e-16

F Z conf c1 S D c3 C c4 N M c2 A
2.55 2.91 3.68 3.77 4.5 5.77 6.91 7.77 9.27 9.64 11.05 11.45 11.73

GMean

Friedman rank sum test

data: averages Friedman chi-squared = 63.001, df = 12, p-value = 6.371e-09

F Z conf c1 c3 S D c4 N C M c2 A
2.36 3.64 4.32 4.68 6.09 6.95 7.59 8 8 8.09 9.64 10.68 10.95

FScore

Friedman rank sum test

data: averages Friedman chi-squared = 101.9, df = 12, p-value = 2.358e-16

F c1 Z conf S D c3 C c4 N M c2 A
2.64 2.82 3.27 3.64 5.05 5.95 7 7.55 9.14 9.41 10.91 11.77 11.86