Restricted Quasi-Independent Model Resolves Paradoxical Behaviors of Cohen’s Kappa

Authors

Vicki Stover Hertzberg, Emory UniversityFollow
Frank Xu, Emory UniversityFollow
Michael Haber, Emory UniversityFollow

Abstract

Cohen’s kappa, an index of inter-rater agreement, behaves paradoxically in 2×2 tables. λ_A is derived, an index from the restricted quasi-independent model for 2×2 tables. Simulation studies are used to demonstrate λ_A has superior performance compared to Scott’s pi. Moreover, λ_A does not show paradoxical behavior for 2×2 tables.

DOI

10.22237/jmasm/1162354500