andreas@unstable:~/ai/indef/% python iaa.py
items: 100
marta katya 0.63395979021
marta andreas 0.625096482523
marta morgan 0.734454525337
marta mariav 0.735249621785
katya andreas 0.624931053502
katya morgan 0.673202614379
katya mariav 0.677912435855
andreas morgan 0.736724176563
andreas mariav 0.755338078292
morgan mariav 0.750055543213
kappa 0.694692432166 std dev 0.0508700562045

WARNING:root:Weighted kappa between marta and katya: 0.595850
WARNING:root:Weighted kappa between marta and andreas: 0.580764
WARNING:root:Weighted kappa between marta and morgan: 0.707460
WARNING:root:Weighted kappa between marta and mariav: 0.696350
WARNING:root:Weighted kappa between katya and andreas: 0.584022
WARNING:root:Weighted kappa between katya and morgan: 0.644386
WARNING:root:Weighted kappa between katya and mariav: 0.637191
WARNING:root:Weighted kappa between andreas and morgan: 0.711125
WARNING:root:Weighted kappa between andreas and mariav: 0.722187
WARNING:root:Weighted kappa between morgan and mariav: 0.721896
weighted kappa 0.66012301946 std dev 0.0555121563938
alpha 0.65955932337

kappa IND-rest 0.995561776338
kappa Q-rest 0.973518536937
kappa CO-rest 0.971285406283
kappa GEN-rest 0.955915812869
kappa SU-rest 0.931729467118
kappa SK-rest 0.929425460789
kappa AM-rest 0.922966479971
kappa AA-rest 0.920730980234
kappa CA-rest 0.920616338312
kappa UFC-rest 0.900880291172
kappa DN-rest 0.898820170869
kappa FC-rest 0.876409200475
kappa IR-rest 0.872281693122