MEASURING OBSERVER AGREEMENT USING THE QUASI-INDEPENDENCE CONCEPT

This article details the use of the quasi-independence concept in measuring observer agreement. A coefficient of agreement is presented which describes magnitude of observer agreement as the probability estimated under a quasi-independence model that responses from different observers will be in agr...

Full description

Saved in:
Bibliographic Details
Published in:Journal of educational measurement 1980-03, Vol.17 (1), p.59-69
Main Author: BERGAN, JOHN R.
Format: Article
Language:English
Subjects:
Crime victims
Degrees of freedom
Logical givens
Maximum likelihood estimation
Maximum likelihood estimators
Observational research
Observational studies
Political independence
Rape
Statistics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article details the use of the quasi-independence concept in measuring observer agreement. A coefficient of agreement is presented which describes magnitude of observer agreement as the probability estimated under a quasi-independence model that responses from different observers will be in agreement. Procedures for assessing the probability of agreement for single response categories or groups of categories within a larger set are also described. Finally, techniques for investigating cases of systematic disagreement are discussed.
ISSN:0022-0655
1745-3984
DOI:10.1111/j.1745-3984.1980.tb00815.x