Cohen’s kappa, an index of inter-rater agreement, behaves paradoxically in 2×2 tables. λA is derived, an index from the restricted quasi-independent model for 2×2 tables. Simulation studies are used to demonstrate λA has superior performance compared to Scott’s pi. Moreover, λA does not show paradoxical behavior for 2×2 tables.
Hertzberg, Vicki Stover; Xu, Frank; and Haber, Michael
"Restricted Quasi-Independent Model Resolves Paradoxical Behaviors of Cohen’s Kappa,"
Journal of Modern Applied Statistical Methods:
2, Article 16.
Available at: http://digitalcommons.wayne.edu/jmasm/vol5/iss2/16