SMEP: stats interrater reliability and agreement

SMEP: stats - interrater reliability and agreement

References

various articles, ???

see also http://stats.stackexchange.com/questions/3539/inter-rater-reliability-for-ordinal-or-interval-data

Formula Reference

SAS manual for FREQ looks good: I used it for cohens_kappa

SPSS technical manual: ? haven't checked yet, but it should have many of those

Wikipedia: some information on individual measures, no details on statistical properties, tests

Code References

R: package irr for writing tests and to see what should be available

ICC is also in one of the nipy packages if I remember correctly nipype see https://github.com/statsmodels/statsmodels/issues/684

matlab - file-exchange BSD-licensed

http://www.mathworks.com/matlabcentral/fileexchange/22122-ipn-tools-for-test-retest-reliability-analysis

several correlation measures, ICC, CCC, Kendal W

http://www.mathworks.com/matlabcentral/fileexchange/22099-intraclass-correlation-coefficient-icc

6 different ICC, used by above

http://www.mathworks.com/matlabcentral/fileexchange/21501-intraclass-correlation-coefficients

similar to previous above, 6 different ICC

http://www.mathworks.com/matlabcentral/fileexchange/26885-intraclass-correlation-coefficient-with-confidence-intervals

?

http://www.mathworks.com/matlabcentral/fileexchange/22308-cohens-kappa-with-customizable-weightings

see also http://www.mathworks.com/matlabcentral/fileexchange/15365 I already have Cohen's kappa

http://www.mathworks.com/matlabcentral/fileexchange/15426-fleisses-kappa

I have fleiss_kappa but not the variance, test

http://www.mathworks.com/matlabcentral/fileexchange/36016-krippendorffs-alpha

R::irr has this also, haven't looked at what it is yet

http://www.mathworks.com/matlabcentral/fileexchange/22645-computing-kappa-index

I don't know what this is, clustering application