Comparison of Imbalanced Learning Methods in the Domain of Sentiment Classification

1 Raw results

1.1 Low-dimesional representation

Dataset	Method	Classifier	G-mean	F-score
books	oMRBB	DecisionTreeClassifier	0.2917173	0.3866989
books	oMRBB	KNeighborsClassifier	0.3519234	0.3945474
books	oMRBB	LogisticRegression	0.3662200	0.4079883
books	oMRBB	NB	0.0742706	0.1896760
books	OVOROS	DecisionTreeClassifier	0.2917200	0.3440029
books	OVOROS	KNeighborsClassifier	0.3693726	0.3662790
books	OVOROS	LogisticRegression	0.4008084	0.4178689
books	OVOROS	NB	0.0247539	0.1228051
books	OVORUS	DecisionTreeClassifier	0.3269186	0.3393163
books	OVORUS	KNeighborsClassifier	0.3446941	0.3470292
books	OVORUS	LogisticRegression	0.3786442	0.3974087
books	OVORUS	NB	0.0306397	0.1464545
books	Single classifier	DecisionTreeClassifier	0.3009523	0.3366763
books	Single classifier	KNeighborsClassifier	0.2677097	0.3563054
books	Single classifier	LogisticRegression	0.1695104	0.3660054
books	Single classifier	NB	0.0163136	0.1178141
books	SOUPBag	DecisionTreeClassifier	0.3500436	0.3985062
books	SOUPBag	KNeighborsClassifier	0.3454753	0.3544457
books	SOUPBag	LogisticRegression	0.3823155	0.4053065
books	SOUPBag	NB	0.0316699	0.1839406
books	uMRBB	DecisionTreeClassifier	0.3339820	0.3997518
books	uMRBB	KNeighborsClassifier	0.3869664	0.4074600
books	uMRBB	LogisticRegression	0.3533231	0.4004811
books	uMRBB	NB	0.2022736	0.2704125
dvd	oMRBB	DecisionTreeClassifier	0.3582125	0.4218002
dvd	oMRBB	KNeighborsClassifier	0.3988078	0.4199451
dvd	oMRBB	LogisticRegression	0.3792348	0.4074041
dvd	oMRBB	NB	0.0695433	0.2151573
dvd	OVOROS	DecisionTreeClassifier	0.3224074	0.3608607
dvd	OVOROS	KNeighborsClassifier	0.3789373	0.3851984
dvd	OVOROS	LogisticRegression	0.3909262	0.4076165
dvd	OVOROS	NB	0.0403593	0.1379633
dvd	OVORUS	DecisionTreeClassifier	0.3460740	0.3554051
dvd	OVORUS	KNeighborsClassifier	0.3996911	0.3946582
dvd	OVORUS	LogisticRegression	0.4066002	0.4164548
dvd	OVORUS	NB	0.0358841	0.1460288
dvd	Single classifier	DecisionTreeClassifier	0.3673068	0.3901066
dvd	Single classifier	KNeighborsClassifier	0.3276730	0.3599029
dvd	Single classifier	LogisticRegression	0.1572811	0.3635674
dvd	Single classifier	NB	0.0398886	0.1623548
dvd	SOUPBag	DecisionTreeClassifier	0.3968817	0.4248768
dvd	SOUPBag	KNeighborsClassifier	0.3811921	0.3805977
dvd	SOUPBag	LogisticRegression	0.4077294	0.4222527
dvd	SOUPBag	NB	0.0543237	0.1837754
dvd	uMRBB	DecisionTreeClassifier	0.3870169	0.4211821
dvd	uMRBB	KNeighborsClassifier	0.3946489	0.4064688
dvd	uMRBB	LogisticRegression	0.3581538	0.3917489
dvd	uMRBB	NB	0.0962309	0.2325142
electronics	oMRBB	DecisionTreeClassifier	0.3453258	0.4186878
electronics	oMRBB	KNeighborsClassifier	0.3704796	0.4153646
electronics	oMRBB	LogisticRegression	0.3678666	0.4165027
electronics	oMRBB	NB	0.2411185	0.3089617
electronics	OVOROS	DecisionTreeClassifier	0.3146222	0.3600044
electronics	OVOROS	KNeighborsClassifier	0.4042885	0.4075511
electronics	OVOROS	LogisticRegression	0.4192134	0.4385690
electronics	OVOROS	NB	0.1869638	0.2754675
electronics	OVORUS	DecisionTreeClassifier	0.3575878	0.3617397
electronics	OVORUS	KNeighborsClassifier	0.4065224	0.4034801
electronics	OVORUS	LogisticRegression	0.4326018	0.4451360
electronics	OVORUS	NB	0.1113051	0.2017747
electronics	Single classifier	DecisionTreeClassifier	0.3495709	0.3730364
electronics	Single classifier	KNeighborsClassifier	0.3287421	0.3873450
electronics	Single classifier	LogisticRegression	0.2416473	0.3733476
electronics	Single classifier	NB	0.2251910	0.2920104
electronics	SOUPBag	DecisionTreeClassifier	0.4248374	0.4411994
electronics	SOUPBag	KNeighborsClassifier	0.4161606	0.4216496
electronics	SOUPBag	LogisticRegression	0.4153912	0.4400478
electronics	SOUPBag	NB	0.2106414	0.3256845
electronics	uMRBB	DecisionTreeClassifier	0.3440563	0.4062342
electronics	uMRBB	KNeighborsClassifier	0.3958320	0.4288584
electronics	uMRBB	LogisticRegression	0.3729571	0.4242950
electronics	uMRBB	NB	0.2289375	0.3009041
kitchen	oMRBB	DecisionTreeClassifier	0.1972051	0.3834712
kitchen	oMRBB	KNeighborsClassifier	0.3021654	0.4052781
kitchen	oMRBB	LogisticRegression	0.3578512	0.4292021
kitchen	oMRBB	NB	0.2707810	0.3120776
kitchen	OVOROS	DecisionTreeClassifier	0.2843941	0.3501678
kitchen	OVOROS	KNeighborsClassifier	0.3387571	0.3589190
kitchen	OVOROS	LogisticRegression	0.4024333	0.4331570
kitchen	OVOROS	NB	0.0579798	0.1527273
kitchen	OVORUS	DecisionTreeClassifier	0.3481067	0.3533676
kitchen	OVORUS	KNeighborsClassifier	0.3733221	0.3736635
kitchen	OVORUS	LogisticRegression	0.4024625	0.4215454
kitchen	OVORUS	NB	0.0900036	0.2524037
kitchen	Single classifier	DecisionTreeClassifier	0.3124909	0.3695246
kitchen	Single classifier	KNeighborsClassifier	0.2862802	0.3609907
kitchen	Single classifier	LogisticRegression	0.1312596	0.3565468
kitchen	Single classifier	NB	0.0794618	0.2058609
kitchen	SOUPBag	DecisionTreeClassifier	0.3646290	0.4280802
kitchen	SOUPBag	KNeighborsClassifier	0.3344339	0.3605964
kitchen	SOUPBag	LogisticRegression	0.4139431	0.4354830
kitchen	SOUPBag	NB	0.1631881	0.3418864
kitchen	uMRBB	DecisionTreeClassifier	0.2334387	0.3915015
kitchen	uMRBB	KNeighborsClassifier	0.2980052	0.3920233
kitchen	uMRBB	LogisticRegression	0.3519957	0.4227356
kitchen	uMRBB	NB	0.2495086	0.3389816
movie_aut1	oMRBB	DecisionTreeClassifier	0.0511426	0.1510227
movie_aut1	oMRBB	KNeighborsClassifier	0.0673090	0.1412024
movie_aut1	oMRBB	LogisticRegression	0.1237838	0.1342029
movie_aut1	oMRBB	NB	0.0148625	0.0569440
movie_aut1	OVOROS	DecisionTreeClassifier	0.0865902	0.1649530
movie_aut1	OVOROS	KNeighborsClassifier	0.0882581	0.1426821
movie_aut1	OVOROS	LogisticRegression	0.0789223	0.1374122
movie_aut1	OVOROS	NB	0.0067631	0.0345327
movie_aut1	OVORUS	DecisionTreeClassifier	0.1072196	0.1300078
movie_aut1	OVORUS	KNeighborsClassifier	0.1166957	0.1273656
movie_aut1	OVORUS	LogisticRegression	0.1052520	0.1331881
movie_aut1	OVORUS	NB	0.0192780	0.0691146
movie_aut1	Single classifier	DecisionTreeClassifier	0.0615876	0.1650932
movie_aut1	Single classifier	KNeighborsClassifier	0.0545227	0.1434411
movie_aut1	Single classifier	LogisticRegression	0.0409865	0.1451784
movie_aut1	Single classifier	NB	0.0057127	0.0363310
movie_aut1	SOUPBag	DecisionTreeClassifier	0.1033430	0.1741522
movie_aut1	SOUPBag	KNeighborsClassifier	0.1044469	0.1424236
movie_aut1	SOUPBag	LogisticRegression	0.1235757	0.1627578
movie_aut1	SOUPBag	NB	0.0129071	0.0538567
movie_aut1	uMRBB	DecisionTreeClassifier	0.0945488	0.1414162
movie_aut1	uMRBB	KNeighborsClassifier	0.0847098	0.1093586
movie_aut1	uMRBB	LogisticRegression	0.1215763	0.1358262
movie_aut1	uMRBB	NB	0.0307669	0.0880715
movie_aut2	oMRBB	DecisionTreeClassifier	0.0413432	0.1463801
movie_aut2	oMRBB	KNeighborsClassifier	0.0469916	0.1389201
movie_aut2	oMRBB	LogisticRegression	0.0623094	0.1315508
movie_aut2	oMRBB	NB	0.0119743	0.0411106
movie_aut2	OVOROS	DecisionTreeClassifier	0.0302322	0.1306206
movie_aut2	OVOROS	KNeighborsClassifier	0.0544571	0.1218574
movie_aut2	OVOROS	LogisticRegression	0.0797054	0.1633636
movie_aut2	OVOROS	NB	0.0037857	0.0173929
movie_aut2	OVORUS	DecisionTreeClassifier	0.1113890	0.1306810
movie_aut2	OVORUS	KNeighborsClassifier	0.1199413	0.1233693
movie_aut2	OVORUS	LogisticRegression	0.1116172	0.1490968
movie_aut2	OVORUS	NB	0.0092905	0.0566421
movie_aut2	Single classifier	DecisionTreeClassifier	0.0374003	0.1334310
movie_aut2	Single classifier	KNeighborsClassifier	0.0289358	0.1175307
movie_aut2	Single classifier	LogisticRegression	0.0221814	0.1390346
movie_aut2	Single classifier	NB	0.0038960	0.0149586
movie_aut2	SOUPBag	DecisionTreeClassifier	0.0438736	0.1363057
movie_aut2	SOUPBag	KNeighborsClassifier	0.0926618	0.1284794
movie_aut2	SOUPBag	LogisticRegression	0.0726055	0.1484906
movie_aut2	SOUPBag	NB	0.0151711	0.0778903
movie_aut2	uMRBB	DecisionTreeClassifier	0.0564714	0.1449117
movie_aut2	uMRBB	KNeighborsClassifier	0.0601280	0.1285618
movie_aut2	uMRBB	LogisticRegression	0.0811092	0.1256624
movie_aut2	uMRBB	NB	0.0242048	0.1000090
movie_aut3	oMRBB	DecisionTreeClassifier	0.0239496	0.1218718
movie_aut3	oMRBB	KNeighborsClassifier	0.0654762	0.1348505
movie_aut3	oMRBB	LogisticRegression	0.0766268	0.1118307
movie_aut3	oMRBB	NB	0.0164353	0.0573161
movie_aut3	OVOROS	DecisionTreeClassifier	0.0277287	0.1126631
movie_aut3	OVOROS	KNeighborsClassifier	0.0745506	0.1283879
movie_aut3	OVOROS	LogisticRegression	0.0618815	0.1110707
movie_aut3	OVOROS	NB	0.0059008	0.0223918
movie_aut3	OVORUS	DecisionTreeClassifier	0.0676763	0.1180221
movie_aut3	OVORUS	KNeighborsClassifier	0.0616105	0.1141324
movie_aut3	OVORUS	LogisticRegression	0.0610944	0.1032991
movie_aut3	OVORUS	NB	0.0117826	0.0512467
movie_aut3	Single classifier	DecisionTreeClassifier	0.0438840	0.1262839
movie_aut3	Single classifier	KNeighborsClassifier	0.0321098	0.1184015
movie_aut3	Single classifier	LogisticRegression	0.0215686	0.1065865
movie_aut3	Single classifier	NB	0.0089171	0.0514057
movie_aut3	SOUPBag	DecisionTreeClassifier	0.0513703	0.1278238
movie_aut3	SOUPBag	KNeighborsClassifier	0.0714451	0.1194519
movie_aut3	SOUPBag	LogisticRegression	0.0679140	0.1178988
movie_aut3	SOUPBag	NB	0.0152190	0.0679007
movie_aut3	uMRBB	DecisionTreeClassifier	0.0819097	0.1383686
movie_aut3	uMRBB	KNeighborsClassifier	0.0679554	0.1140160
movie_aut3	uMRBB	LogisticRegression	0.0724295	0.1023014
movie_aut3	uMRBB	NB	0.0333060	0.0805366
movie_aut4	oMRBB	DecisionTreeClassifier	0.1042392	0.2128456
movie_aut4	oMRBB	KNeighborsClassifier	0.1114730	0.2032618
movie_aut4	oMRBB	LogisticRegression	0.1097558	0.1660354
movie_aut4	oMRBB	NB	0.0362520	0.1016939
movie_aut4	OVOROS	DecisionTreeClassifier	0.0736884	0.1686948
movie_aut4	OVOROS	KNeighborsClassifier	0.1470535	0.2018499
movie_aut4	OVOROS	LogisticRegression	0.1255029	0.1968691
movie_aut4	OVOROS	NB	0.0243535	0.0816734
movie_aut4	OVORUS	DecisionTreeClassifier	0.1193783	0.1676557
movie_aut4	OVORUS	KNeighborsClassifier	0.1592082	0.1717767
movie_aut4	OVORUS	LogisticRegression	0.1169756	0.1775055
movie_aut4	OVORUS	NB	0.0300809	0.1187458
movie_aut4	Single classifier	DecisionTreeClassifier	0.0878378	0.1823444
movie_aut4	Single classifier	KNeighborsClassifier	0.1112508	0.1936012
movie_aut4	Single classifier	LogisticRegression	0.0963097	0.2073617
movie_aut4	Single classifier	NB	0.0197647	0.0851967
movie_aut4	SOUPBag	DecisionTreeClassifier	0.1147301	0.1969155
movie_aut4	SOUPBag	KNeighborsClassifier	0.1513718	0.1911128
movie_aut4	SOUPBag	LogisticRegression	0.1359755	0.1966301
movie_aut4	SOUPBag	NB	0.0390405	0.1196174
movie_aut4	uMRBB	DecisionTreeClassifier	0.1598139	0.1569266
movie_aut4	uMRBB	KNeighborsClassifier	0.2012726	0.1910361
movie_aut4	uMRBB	LogisticRegression	0.1179459	0.1655592
movie_aut4	uMRBB	NB	0.0823242	0.1348251
restaurants	oMRBB	DecisionTreeClassifier	0.4455916	0.5324937
restaurants	oMRBB	KNeighborsClassifier	0.5562922	0.5638081
restaurants	oMRBB	LogisticRegression	0.5120750	0.5582222
restaurants	oMRBB	NB	0.4376352	0.5011880
restaurants	OVOROS	DecisionTreeClassifier	0.4239591	0.4988898
restaurants	OVOROS	KNeighborsClassifier	0.5262333	0.5222276
restaurants	OVOROS	LogisticRegression	0.5856758	0.5921550
restaurants	OVOROS	NB	0.4651649	0.4957092
restaurants	OVORUS	DecisionTreeClassifier	0.4961348	0.5219605
restaurants	OVORUS	KNeighborsClassifier	0.5243748	0.5209514
restaurants	OVORUS	LogisticRegression	0.5961686	0.5913946
restaurants	OVORUS	NB	0.4566264	0.4886722
restaurants	Single classifier	DecisionTreeClassifier	0.4543659	0.4907508
restaurants	Single classifier	KNeighborsClassifier	0.4532630	0.5101846
restaurants	Single classifier	LogisticRegression	0.4635212	0.5585812
restaurants	Single classifier	NB	0.4467553	0.4964281
restaurants	SOUPBag	DecisionTreeClassifier	0.5743468	0.5767805
restaurants	SOUPBag	KNeighborsClassifier	0.5064395	0.5031361
restaurants	SOUPBag	LogisticRegression	0.5851707	0.5770549
restaurants	SOUPBag	NB	0.4652664	0.4892049
restaurants	uMRBB	DecisionTreeClassifier	0.5347679	0.5795646
restaurants	uMRBB	KNeighborsClassifier	0.5583567	0.5641425
restaurants	uMRBB	LogisticRegression	0.5218307	0.5627153
restaurants	uMRBB	NB	0.4559348	0.5031161
tripadvisor	oMRBB	DecisionTreeClassifier	0.4068961	0.4298547
tripadvisor	oMRBB	KNeighborsClassifier	0.4104198	0.4230619
tripadvisor	oMRBB	LogisticRegression	0.3785224	0.4063513
tripadvisor	oMRBB	NB	0.1221462	0.2762543
tripadvisor	OVOROS	DecisionTreeClassifier	0.3759802	0.4037058
tripadvisor	OVOROS	KNeighborsClassifier	0.3972490	0.3973399
tripadvisor	OVOROS	LogisticRegression	0.4706925	0.4658148
tripadvisor	OVOROS	NB	0.2091430	0.3120939
tripadvisor	OVORUS	DecisionTreeClassifier	0.3794307	0.3857775
tripadvisor	OVORUS	KNeighborsClassifier	0.4232645	0.4139668
tripadvisor	OVORUS	LogisticRegression	0.4698649	0.4644506
tripadvisor	OVORUS	NB	0.1308645	0.2600258
tripadvisor	Single classifier	DecisionTreeClassifier	0.3441249	0.3821695
tripadvisor	Single classifier	KNeighborsClassifier	0.3417171	0.3863250
tripadvisor	Single classifier	LogisticRegression	0.3415131	0.4327657
tripadvisor	Single classifier	NB	0.1785291	0.2949327
tripadvisor	SOUPBag	DecisionTreeClassifier	0.4523385	0.4446310
tripadvisor	SOUPBag	KNeighborsClassifier	0.4138105	0.3986156
tripadvisor	SOUPBag	LogisticRegression	0.4711450	0.4549257
tripadvisor	SOUPBag	NB	0.0772319	0.2532454
tripadvisor	uMRBB	DecisionTreeClassifier	0.4015467	0.4263327
tripadvisor	uMRBB	KNeighborsClassifier	0.4221961	0.4276884
tripadvisor	uMRBB	LogisticRegression	0.3760222	0.4055451
tripadvisor	uMRBB	NB	0.1325926	0.2903704
tweeter3point	oMRBB	DecisionTreeClassifier	0.4677755	0.4701457
tweeter3point	oMRBB	KNeighborsClassifier	0.4637097	0.4299835
tweeter3point	oMRBB	LogisticRegression	0.4752041	0.4671444
tweeter3point	oMRBB	NB	0.2128813	0.3755190
tweeter3point	OVOROS	DecisionTreeClassifier	0.4045257	0.4175461
tweeter3point	OVOROS	KNeighborsClassifier	0.4382120	0.4303717
tweeter3point	OVOROS	LogisticRegression	0.4915769	0.4765645
tweeter3point	OVOROS	NB	0.0589192	0.3133930
tweeter3point	OVORUS	DecisionTreeClassifier	0.4213620	0.4187468
tweeter3point	OVORUS	KNeighborsClassifier	0.4542133	0.4422950
tweeter3point	OVORUS	LogisticRegression	0.4945342	0.4787228
tweeter3point	OVORUS	NB	0.0716896	0.2804748
tweeter3point	Single classifier	DecisionTreeClassifier	0.3700091	0.3938860
tweeter3point	Single classifier	KNeighborsClassifier	0.4163424	0.4434540
tweeter3point	Single classifier	LogisticRegression	0.3637297	0.4389999
tweeter3point	Single classifier	NB	0.0584105	0.3137030
tweeter3point	SOUPBag	DecisionTreeClassifier	0.4807961	0.4704586
tweeter3point	SOUPBag	KNeighborsClassifier	0.4538195	0.4371713
tweeter3point	SOUPBag	LogisticRegression	0.4917851	0.4716332
tweeter3point	SOUPBag	NB	0.1505768	0.3431856
tweeter3point	uMRBB	DecisionTreeClassifier	0.4566441	0.4674646
tweeter3point	uMRBB	KNeighborsClassifier	0.4342070	0.4000144
tweeter3point	uMRBB	LogisticRegression	0.4760274	0.4665324
tweeter3point	uMRBB	NB	0.2072800	0.3790636
tweeter5point	oMRBB	DecisionTreeClassifier	0.1296194	0.2779106
tweeter5point	oMRBB	KNeighborsClassifier	0.1260790	0.2151176
tweeter5point	oMRBB	LogisticRegression	0.3275667	0.2286042
tweeter5point	oMRBB	NB	0.1255732	0.1084363
tweeter5point	OVOROS	DecisionTreeClassifier	0.2724432	0.2612048
tweeter5point	OVOROS	KNeighborsClassifier	0.2772142	0.2316682
tweeter5point	OVOROS	LogisticRegression	0.3654367	0.2559138
tweeter5point	OVOROS	NB	0.0156613	0.0418514
tweeter5point	OVORUS	DecisionTreeClassifier	0.2810510	0.2108579
tweeter5point	OVORUS	KNeighborsClassifier	0.2998631	0.2172226
tweeter5point	OVORUS	LogisticRegression	0.3540967	0.2486527
tweeter5point	OVORUS	NB	0.0347619	0.1109580
tweeter5point	Single classifier	DecisionTreeClassifier	0.1515384	0.2364724
tweeter5point	Single classifier	KNeighborsClassifier	0.1838274	0.2521246
tweeter5point	Single classifier	LogisticRegression	0.0623451	0.2208253
tweeter5point	Single classifier	NB	0.0155762	0.0429830
tweeter5point	SOUPBag	DecisionTreeClassifier	0.2351555	0.2851492
tweeter5point	SOUPBag	KNeighborsClassifier	0.2796485	0.2376850
tweeter5point	SOUPBag	LogisticRegression	0.3718417	0.2663579
tweeter5point	SOUPBag	NB	0.1047245	0.1712129
tweeter5point	uMRBB	DecisionTreeClassifier	0.3038090	0.2613072
tweeter5point	uMRBB	KNeighborsClassifier	0.3022716	0.2261836
tweeter5point	uMRBB	LogisticRegression	0.3254391	0.2266729
tweeter5point	uMRBB	NB	0.2537180	0.2002029

1.2 High-dimesional representation

Dataset	Method	Classifier	G-mean	F-score
books	oMRBB	DecisionTreeClassifier	0.2983545	0.4145216
books	oMRBB	KNeighborsClassifier	0.4030663	0.4164032
books	oMRBB	LogisticRegression	0.4696096	0.4766374
books	oMRBB	NB	0.3393669	0.3825529
books	OVOROS	DecisionTreeClassifier	0.3149795	0.3555511
books	OVOROS	KNeighborsClassifier	0.3395407	0.3468690
books	OVOROS	LogisticRegression	0.4629111	0.4707039
books	OVOROS	NB	0.3533105	0.3851354
books	OVORUS	DecisionTreeClassifier	0.3492021	0.3543922
books	OVORUS	KNeighborsClassifier	0.3421175	0.3364046
books	OVORUS	LogisticRegression	0.4833292	0.4759979
books	OVORUS	NB	0.3653952	0.3870288
books	Single classifier	DecisionTreeClassifier	0.3235360	0.3439964
books	Single classifier	KNeighborsClassifier	0.3267551	0.3580247
books	Single classifier	LogisticRegression	0.4349999	0.4792883
books	Single classifier	NB	0.3666361	0.3937111
books	SOUPBag	DecisionTreeClassifier	0.3588256	0.4267627
books	SOUPBag	KNeighborsClassifier	0.3391588	0.3376300
books	SOUPBag	LogisticRegression	0.4871802	0.4850614
books	SOUPBag	NB	0.3825490	0.3980808
books	uMRBB	DecisionTreeClassifier	0.3444835	0.4214933
books	uMRBB	KNeighborsClassifier	0.3895249	0.3925118
books	uMRBB	LogisticRegression	0.4741577	0.4797222
books	uMRBB	NB	0.3506831	0.3931615
dvd	oMRBB	DecisionTreeClassifier	0.2833776	0.3919267
dvd	oMRBB	KNeighborsClassifier	0.3881976	0.4089740
dvd	oMRBB	LogisticRegression	0.4953564	0.4960570
dvd	oMRBB	NB	0.3743071	0.3874882
dvd	OVOROS	DecisionTreeClassifier	0.3195143	0.3516595
dvd	OVOROS	KNeighborsClassifier	0.3466769	0.3567790
dvd	OVOROS	LogisticRegression	0.4748974	0.4774398
dvd	OVOROS	NB	0.3500011	0.3744304
dvd	OVORUS	DecisionTreeClassifier	0.3464613	0.3561440
dvd	OVORUS	KNeighborsClassifier	0.3648147	0.3574971
dvd	OVORUS	LogisticRegression	0.4841625	0.4755722
dvd	OVORUS	NB	0.3883037	0.3929056
dvd	Single classifier	DecisionTreeClassifier	0.3004802	0.3249368
dvd	Single classifier	KNeighborsClassifier	0.3205018	0.3544049
dvd	Single classifier	LogisticRegression	0.4237417	0.4561659
dvd	Single classifier	NB	0.3896462	0.4000349
dvd	SOUPBag	DecisionTreeClassifier	0.3781128	0.4257031
dvd	SOUPBag	KNeighborsClassifier	0.3432747	0.3515929
dvd	SOUPBag	LogisticRegression	0.4666666	0.4681109
dvd	SOUPBag	NB	0.3689144	0.3799546
dvd	uMRBB	DecisionTreeClassifier	0.3649644	0.4236498
dvd	uMRBB	KNeighborsClassifier	0.3863752	0.4026309
dvd	uMRBB	LogisticRegression	0.4757476	0.4787343
dvd	uMRBB	NB	0.3693471	0.3883809
electronics	oMRBB	DecisionTreeClassifier	0.3023450	0.3999820
electronics	oMRBB	KNeighborsClassifier	0.4092655	0.4027407
electronics	oMRBB	LogisticRegression	0.4586050	0.4731887
electronics	oMRBB	NB	0.3321220	0.3672038
electronics	OVOROS	DecisionTreeClassifier	0.3172422	0.3552107
electronics	OVOROS	KNeighborsClassifier	0.3702595	0.3619012
electronics	OVOROS	LogisticRegression	0.4815496	0.4934361
electronics	OVOROS	NB	0.3477895	0.3679592
electronics	OVORUS	DecisionTreeClassifier	0.3299553	0.3366985
electronics	OVORUS	KNeighborsClassifier	0.3429416	0.3290522
electronics	OVORUS	LogisticRegression	0.4854032	0.4777228
electronics	OVORUS	NB	0.3549858	0.3718001
electronics	Single classifier	DecisionTreeClassifier	0.3162768	0.3366322
electronics	Single classifier	KNeighborsClassifier	0.3437533	0.3699597
electronics	Single classifier	LogisticRegression	0.4337595	0.4774385
electronics	Single classifier	NB	0.3525083	0.3747691
electronics	SOUPBag	DecisionTreeClassifier	0.4085086	0.4425935
electronics	SOUPBag	KNeighborsClassifier	0.3707211	0.3576352
electronics	SOUPBag	LogisticRegression	0.4882671	0.4890505
electronics	SOUPBag	NB	0.3592019	0.3730301
electronics	uMRBB	DecisionTreeClassifier	0.3414085	0.4167975
electronics	uMRBB	KNeighborsClassifier	0.3959818	0.3999636
electronics	uMRBB	LogisticRegression	0.4486824	0.4662924
electronics	uMRBB	NB	0.3402405	0.3696299
kitchen	oMRBB	DecisionTreeClassifier	0.1714784	0.3658227
kitchen	oMRBB	KNeighborsClassifier	0.3745307	0.4146848
kitchen	oMRBB	LogisticRegression	0.4347871	0.4655998
kitchen	oMRBB	NB	0.3498346	0.3722786
kitchen	OVOROS	DecisionTreeClassifier	0.2713884	0.3416972
kitchen	OVOROS	KNeighborsClassifier	0.3495916	0.3534283
kitchen	OVOROS	LogisticRegression	0.4347142	0.4648617
kitchen	OVOROS	NB	0.3529616	0.3673157
kitchen	OVORUS	DecisionTreeClassifier	0.3279705	0.3309011
kitchen	OVORUS	KNeighborsClassifier	0.3407261	0.3248236
kitchen	OVORUS	LogisticRegression	0.4520680	0.4512959
kitchen	OVORUS	NB	0.3662201	0.3671650
kitchen	Single classifier	DecisionTreeClassifier	0.2962674	0.3410435
kitchen	Single classifier	KNeighborsClassifier	0.2878902	0.3661785
kitchen	Single classifier	LogisticRegression	0.3686575	0.4599252
kitchen	Single classifier	NB	0.3545719	0.3746737
kitchen	SOUPBag	DecisionTreeClassifier	0.3331384	0.4254996
kitchen	SOUPBag	KNeighborsClassifier	0.3638533	0.3510664
kitchen	SOUPBag	LogisticRegression	0.4648018	0.4777142
kitchen	SOUPBag	NB	0.3540134	0.3630569
kitchen	uMRBB	DecisionTreeClassifier	0.2764534	0.3982008
kitchen	uMRBB	KNeighborsClassifier	0.4058211	0.4059934
kitchen	uMRBB	LogisticRegression	0.4369327	0.4673355
kitchen	uMRBB	NB	0.3525239	0.3812080
movie_aut1	oMRBB	DecisionTreeClassifier	0.0518373	0.1700009
movie_aut1	oMRBB	KNeighborsClassifier	0.1214869	0.1872103
movie_aut1	oMRBB	LogisticRegression	0.2420598	0.2291792
movie_aut1	oMRBB	NB	0.0818219	0.1303066
movie_aut1	OVOROS	DecisionTreeClassifier	0.0785312	0.1856956
movie_aut1	OVOROS	KNeighborsClassifier	0.1573581	0.1801225
movie_aut1	OVOROS	LogisticRegression	0.2326863	0.2650412
movie_aut1	OVOROS	NB	0.1017895	0.1160739
movie_aut1	OVORUS	DecisionTreeClassifier	0.1658440	0.1632821
movie_aut1	OVORUS	KNeighborsClassifier	0.1073599	0.1423000
movie_aut1	OVORUS	LogisticRegression	0.2483391	0.2197607
movie_aut1	OVORUS	NB	0.0544142	0.1105734
movie_aut1	Single classifier	DecisionTreeClassifier	0.0844502	0.1577968
movie_aut1	Single classifier	KNeighborsClassifier	0.0717531	0.1837856
movie_aut1	Single classifier	LogisticRegression	0.1125014	0.2325395
movie_aut1	Single classifier	NB	0.0707951	0.1132761
movie_aut1	SOUPBag	DecisionTreeClassifier	0.0796195	0.1860919
movie_aut1	SOUPBag	KNeighborsClassifier	0.1468551	0.1625823
movie_aut1	SOUPBag	LogisticRegression	0.2003119	0.2347404
movie_aut1	SOUPBag	NB	0.1411516	0.1571355
movie_aut1	uMRBB	DecisionTreeClassifier	0.1559134	0.2155042
movie_aut1	uMRBB	KNeighborsClassifier	0.1493268	0.1702196
movie_aut1	uMRBB	LogisticRegression	0.1769822	0.1963353
movie_aut1	uMRBB	NB	0.1515093	0.1782636
movie_aut2	oMRBB	DecisionTreeClassifier	0.0429237	0.1743885
movie_aut2	oMRBB	KNeighborsClassifier	0.0733974	0.2024602
movie_aut2	oMRBB	LogisticRegression	0.2045759	0.2235397
movie_aut2	oMRBB	NB	0.1151511	0.1903504
movie_aut2	OVOROS	DecisionTreeClassifier	0.0538478	0.1788984
movie_aut2	OVOROS	KNeighborsClassifier	0.1313783	0.1851020
movie_aut2	OVOROS	LogisticRegression	0.1564880	0.2561267
movie_aut2	OVOROS	NB	0.0571875	0.1594805
movie_aut2	OVORUS	DecisionTreeClassifier	0.1105665	0.1740219
movie_aut2	OVORUS	KNeighborsClassifier	0.1268921	0.1300564
movie_aut2	OVORUS	LogisticRegression	0.2174164	0.1884416
movie_aut2	OVORUS	NB	0.1181714	0.1643576
movie_aut2	Single classifier	DecisionTreeClassifier	0.0408664	0.1467667
movie_aut2	Single classifier	KNeighborsClassifier	0.0540853	0.1816314
movie_aut2	Single classifier	LogisticRegression	0.0698437	0.2103809
movie_aut2	Single classifier	NB	0.0797558	0.1670037
movie_aut2	SOUPBag	DecisionTreeClassifier	0.0955182	0.1981839
movie_aut2	SOUPBag	KNeighborsClassifier	0.1154280	0.1390321
movie_aut2	SOUPBag	LogisticRegression	0.1527586	0.2098014
movie_aut2	SOUPBag	NB	0.0430218	0.1649507
movie_aut2	uMRBB	DecisionTreeClassifier	0.2091098	0.1975571
movie_aut2	uMRBB	KNeighborsClassifier	0.1459420	0.1587781
movie_aut2	uMRBB	LogisticRegression	0.1887698	0.1903276
movie_aut2	uMRBB	NB	0.0900226	0.1892413
movie_aut3	oMRBB	DecisionTreeClassifier	0.0173204	0.1015749
movie_aut3	oMRBB	KNeighborsClassifier	0.0542261	0.1359047
movie_aut3	oMRBB	LogisticRegression	0.0940500	0.1242031
movie_aut3	oMRBB	NB	0.0615823	0.0958205
movie_aut3	OVOROS	DecisionTreeClassifier	0.0307934	0.1222183
movie_aut3	OVOROS	KNeighborsClassifier	0.0658237	0.1341705
movie_aut3	OVOROS	LogisticRegression	0.1223326	0.1705511
movie_aut3	OVOROS	NB	0.0390488	0.1045278
movie_aut3	OVORUS	DecisionTreeClassifier	0.0835085	0.1345872
movie_aut3	OVORUS	KNeighborsClassifier	0.0931239	0.1289924
movie_aut3	OVORUS	LogisticRegression	0.1316536	0.1341524
movie_aut3	OVORUS	NB	0.0571697	0.0915386
movie_aut3	Single classifier	DecisionTreeClassifier	0.0455799	0.1216445
movie_aut3	Single classifier	KNeighborsClassifier	0.0436117	0.1169175
movie_aut3	Single classifier	LogisticRegression	0.0309259	0.1129124
movie_aut3	Single classifier	NB	0.0423734	0.1077557
movie_aut3	SOUPBag	DecisionTreeClassifier	0.0302842	0.1052357
movie_aut3	SOUPBag	KNeighborsClassifier	0.0656167	0.1231342
movie_aut3	SOUPBag	LogisticRegression	0.0522927	0.1390147
movie_aut3	SOUPBag	NB	0.0474774	0.1173135
movie_aut3	uMRBB	DecisionTreeClassifier	0.0700023	0.1330665
movie_aut3	uMRBB	KNeighborsClassifier	0.0619297	0.1161419
movie_aut3	uMRBB	LogisticRegression	0.1444128	0.1487414
movie_aut3	uMRBB	NB	0.1053830	0.1524819
movie_aut4	oMRBB	DecisionTreeClassifier	0.0785712	0.2131898
movie_aut4	oMRBB	KNeighborsClassifier	0.1401993	0.2223319
movie_aut4	oMRBB	LogisticRegression	0.1870919	0.2383909
movie_aut4	oMRBB	NB	0.1339102	0.2031314
movie_aut4	OVOROS	DecisionTreeClassifier	0.0980717	0.2158911
movie_aut4	OVOROS	KNeighborsClassifier	0.1146108	0.2121576
movie_aut4	OVOROS	LogisticRegression	0.1839768	0.3048900
movie_aut4	OVOROS	NB	0.1260932	0.2147004
movie_aut4	OVORUS	DecisionTreeClassifier	0.1200945	0.1957360
movie_aut4	OVORUS	KNeighborsClassifier	0.1104040	0.1407541
movie_aut4	OVORUS	LogisticRegression	0.2117031	0.2381725
movie_aut4	OVORUS	NB	0.1163579	0.1858603
movie_aut4	Single classifier	DecisionTreeClassifier	0.0901326	0.1700487
movie_aut4	Single classifier	KNeighborsClassifier	0.1266079	0.2168029
movie_aut4	Single classifier	LogisticRegression	0.1316072	0.2795839
movie_aut4	Single classifier	NB	0.1487046	0.2309307
movie_aut4	SOUPBag	DecisionTreeClassifier	0.1343875	0.2517186
movie_aut4	SOUPBag	KNeighborsClassifier	0.1202629	0.1830146
movie_aut4	SOUPBag	LogisticRegression	0.1781344	0.2791384
movie_aut4	SOUPBag	NB	0.1445096	0.2288785
movie_aut4	uMRBB	DecisionTreeClassifier	0.1351741	0.1761779
movie_aut4	uMRBB	KNeighborsClassifier	0.1089366	0.1627569
movie_aut4	uMRBB	LogisticRegression	0.1690684	0.2202208
movie_aut4	uMRBB	NB	0.1027984	0.1954487
restaurants	oMRBB	DecisionTreeClassifier	0.4674985	0.5466989
restaurants	oMRBB	KNeighborsClassifier	0.3941161	0.4769695
restaurants	oMRBB	LogisticRegression	0.5867624	0.5943464
restaurants	oMRBB	NB	0.5020172	0.5331062
restaurants	OVOROS	DecisionTreeClassifier	0.3375278	0.4068071
restaurants	OVOROS	KNeighborsClassifier	0.4039949	0.4581635
restaurants	OVOROS	LogisticRegression	0.6007926	0.6055873
restaurants	OVOROS	NB	0.5143623	0.5423299
restaurants	OVORUS	DecisionTreeClassifier	0.3949024	0.4231063
restaurants	OVORUS	KNeighborsClassifier	0.3970703	0.4528674
restaurants	OVORUS	LogisticRegression	0.6083913	0.6000835
restaurants	OVORUS	NB	0.5526258	0.5652621
restaurants	Single classifier	DecisionTreeClassifier	0.3704487	0.4029809
restaurants	Single classifier	KNeighborsClassifier	0.3794410	0.4540864
restaurants	Single classifier	LogisticRegression	0.5650310	0.6006511
restaurants	Single classifier	NB	0.5254546	0.5501926
restaurants	SOUPBag	DecisionTreeClassifier	0.5487529	0.5690809
restaurants	SOUPBag	KNeighborsClassifier	0.4253781	0.4654388
restaurants	SOUPBag	LogisticRegression	0.6283482	0.6198494
restaurants	SOUPBag	NB	0.5479170	0.5601444
restaurants	uMRBB	DecisionTreeClassifier	0.5133724	0.5657402
restaurants	uMRBB	KNeighborsClassifier	0.3750901	0.4612644
restaurants	uMRBB	LogisticRegression	0.5901394	0.5967214
restaurants	uMRBB	NB	0.5285033	0.5555287
tripadvisor	oMRBB	DecisionTreeClassifier	0.4231759	0.4561312
tripadvisor	oMRBB	KNeighborsClassifier	0.4510232	0.4627391
tripadvisor	oMRBB	LogisticRegression	0.4762244	0.4689881
tripadvisor	oMRBB	NB	0.4328015	0.4191982
tripadvisor	OVOROS	DecisionTreeClassifier	0.3302058	0.3783598
tripadvisor	OVOROS	KNeighborsClassifier	0.4022137	0.4068495
tripadvisor	OVOROS	LogisticRegression	0.5332978	0.5243553
tripadvisor	OVOROS	NB	0.4477159	0.4257402
tripadvisor	OVORUS	DecisionTreeClassifier	0.3737533	0.3792623
tripadvisor	OVORUS	KNeighborsClassifier	0.4206089	0.4119924
tripadvisor	OVORUS	LogisticRegression	0.5421816	0.5263896
tripadvisor	OVORUS	NB	0.4486215	0.4242171
tripadvisor	Single classifier	DecisionTreeClassifier	0.3078294	0.3488393
tripadvisor	Single classifier	KNeighborsClassifier	0.3398651	0.3753565
tripadvisor	Single classifier	LogisticRegression	0.4923086	0.5326898
tripadvisor	Single classifier	NB	0.4454842	0.4282618
tripadvisor	SOUPBag	DecisionTreeClassifier	0.4304109	0.4408686
tripadvisor	SOUPBag	KNeighborsClassifier	0.4044157	0.3841413
tripadvisor	SOUPBag	LogisticRegression	0.5349066	0.5137703
tripadvisor	SOUPBag	NB	0.4382033	0.4088543
tripadvisor	uMRBB	DecisionTreeClassifier	0.4279230	0.4508566
tripadvisor	uMRBB	KNeighborsClassifier	0.4693717	0.4625490
tripadvisor	uMRBB	LogisticRegression	0.4791215	0.4703872
tripadvisor	uMRBB	NB	0.4347243	0.4195407
tweeter3point	oMRBB	DecisionTreeClassifier	0.4347191	0.4769175
tweeter3point	oMRBB	KNeighborsClassifier	0.4641422	0.4793737
tweeter3point	oMRBB	LogisticRegression	0.4888228	0.4829154
tweeter3point	oMRBB	NB	0.4737816	0.4522576
tweeter3point	OVOROS	DecisionTreeClassifier	0.3825972	0.4130490
tweeter3point	OVOROS	KNeighborsClassifier	0.4616526	0.4484364
tweeter3point	OVOROS	LogisticRegression	0.5192221	0.5067992
tweeter3point	OVOROS	NB	0.4817996	0.4576262
tweeter3point	OVORUS	DecisionTreeClassifier	0.3990000	0.4004675
tweeter3point	OVORUS	KNeighborsClassifier	0.4563463	0.4398798
tweeter3point	OVORUS	LogisticRegression	0.5200780	0.5022892
tweeter3point	OVORUS	NB	0.4824177	0.4576811
tweeter3point	Single classifier	DecisionTreeClassifier	0.3687956	0.3961303
tweeter3point	Single classifier	KNeighborsClassifier	0.4383260	0.4594289
tweeter3point	Single classifier	LogisticRegression	0.4580646	0.5035081
tweeter3point	Single classifier	NB	0.4846984	0.4644283
tweeter3point	SOUPBag	DecisionTreeClassifier	0.4858896	0.4964717
tweeter3point	SOUPBag	KNeighborsClassifier	0.4803697	0.4549222
tweeter3point	SOUPBag	LogisticRegression	0.5259041	0.5052176
tweeter3point	SOUPBag	NB	0.4854472	0.4563604
tweeter3point	uMRBB	DecisionTreeClassifier	0.4499313	0.4807965
tweeter3point	uMRBB	KNeighborsClassifier	0.4815371	0.4869490
tweeter3point	uMRBB	LogisticRegression	0.4887481	0.4833291
tweeter3point	uMRBB	NB	0.4788989	0.4562203
tweeter5point	oMRBB	DecisionTreeClassifier	0.0878290	0.2941632
tweeter5point	oMRBB	KNeighborsClassifier	0.1887872	0.3201544
tweeter5point	oMRBB	LogisticRegression	0.3970205	0.2783574
tweeter5point	oMRBB	NB	0.3532868	0.2454180
tweeter5point	OVOROS	DecisionTreeClassifier	0.2368119	0.2695478
tweeter5point	OVOROS	KNeighborsClassifier	0.3456061	0.2711513
tweeter5point	OVOROS	LogisticRegression	0.3826115	0.3230804
tweeter5point	OVOROS	NB	0.3577464	0.2594348
tweeter5point	OVORUS	DecisionTreeClassifier	0.2731771	0.2229260
tweeter5point	OVORUS	KNeighborsClassifier	0.3261060	0.2306445
tweeter5point	OVORUS	LogisticRegression	0.3937471	0.2871078
tweeter5point	OVORUS	NB	0.3387283	0.2392302
tweeter5point	Single classifier	DecisionTreeClassifier	0.1211288	0.2396925
tweeter5point	Single classifier	KNeighborsClassifier	0.2144620	0.2870566
tweeter5point	Single classifier	LogisticRegression	0.1566471	0.3215525
tweeter5point	Single classifier	NB	0.3720023	0.2913587
tweeter5point	SOUPBag	DecisionTreeClassifier	0.1148504	0.3088060
tweeter5point	SOUPBag	KNeighborsClassifier	0.3381292	0.2827558
tweeter5point	SOUPBag	LogisticRegression	0.3985882	0.3288460
tweeter5point	SOUPBag	NB	0.3394650	0.2603613
tweeter5point	uMRBB	DecisionTreeClassifier	0.1977388	0.2814505
tweeter5point	uMRBB	KNeighborsClassifier	0.3253326	0.2437645
tweeter5point	uMRBB	LogisticRegression	0.3867337	0.2714465
tweeter5point	uMRBB	NB	0.3356992	0.2422956

2 Friedman tests for the datasets understudy

The tests are performed for ensemble methods assuming that the best (i.e. with the highest result) base classifier for a given method and dataset is chosen.

2.1 Low-dimesional representation

2.1.1 G-mean

---

Friedman rank sum test
Friedman chi-squared = 41.286, df = 5, p-value = 8.215e-08

SOUPBag	uMRBB	OVORUS	OVOROS	oMRBB	Single classifier
1.67	2.25	3	3.92	4.17	6

---

2.1.2 F-score

---

Friedman rank sum test
Friedman chi-squared = 34.619, df = 5, p-value = 1.792e-06

SOUPBag	uMRBB	oMRBB	OVOROS	OVORUS	Single classifier
1.83	2.33	2.58	4.25	4.83	5.17

---

2.2 High-dimesional representation

2.2.1 G-mean

---

Friedman rank sum test
Friedman chi-squared = 39.571, df = 5, p-value = 1.822e-07

uMRBB	SOUPBag	OVORUS	oMRBB	OVOROS	Single classifier
2	2.33	2.5	4.08	4.08	6

---

2.2.2 F-score

---

Friedman rank sum test
Friedman chi-squared = 24.905, df = 5, p-value = 0.0001454

uMRBB	SOUPBag	oMRBB	OVOROS	Single classifier	OVORUS
2.33	2.42	2.75	3.67	4.67	5.17

---