Powerful exact unconditional tests for agreement between two raters with binary endpoints

Asymptotic and exact conditional approaches have often been used for testing agreement between two raters with binary outcomes. The exact conditional approach is guaranteed to respect the test size as compared to the traditionally used asymptotic approach based on the standardized Cohen's kappa...

Full description

Saved in:
Bibliographic Details
Published in:PloS one 2014-05, Vol.9 (5), p.e97386
Main Authors: Shan, Guogen, Wilding, Gregory E
Format: Article
Language:English
Subjects:
Agreements
Biometrics
Contingency tables
Diagnostic Techniques and Procedures - standards
Epidemiology
Humans
Maximization
Models, Statistical
Normal distribution
Observer Variation
Patients
Physical Sciences
Physical therapy
Probability
Range of Motion, Articular - physiology
Spinal Diseases - diagnosis
Statistical methods
Statistics
Studies
Sweden
Test procedures
Testing procedures
Trends
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Asymptotic and exact conditional approaches have often been used for testing agreement between two raters with binary outcomes. The exact conditional approach is guaranteed to respect the test size as compared to the traditionally used asymptotic approach based on the standardized Cohen's kappa coefficient. An alternative to the conditional approach is an unconditional strategy which relaxes the restriction of fixed marginal totals as in the conditional approach. Three exact unconditional hypothesis testing procedures are considered in this article: an approach based on maximization, an approach based on the conditional p-value and maximization, and an approach based on estimation and maximization. We compared these testing procedures based on the commonly used Cohen's kappa with regards to test size and power. We recommend the following two exact approaches for use in practice due to power advantages: the approach based on conditional p-value and maximization and the approach based on estimation and maximization.
ISSN:1932-6203
1932-6203
DOI:10.1371/journal.pone.0097386