Selection of Common Items as an Unrecognized Source of Variability in Test Equating: A Bootstrap Approximation Assuming Random Sampling of Common Items

The standard error of equating quantifies the variability in the estimation of an equating function. Because common items for deriving equated scores are treated as fixed, the only source of variability typically considered arises from the estimation of common-item parameters from responses of sampl...

Full description

Saved in:
Bibliographic Details
Published in:Applied measurement in education 2014-01, Vol.27 (1), p.46-57
Main Authors: Michaelides, Michalis P., Haertel, Edward H.
Format: Article
Language:English
Subjects:
Academic standards
Approximation
Bootstrap method
Computation
Difficulty Level
Educational tests & measurements
Equated Scores
Error of Measurement
Grade 8
Item Analysis
Item Response Theory
Mathematics Tests
Measurement
Measurement errors
Sample Size
Sampling
Statistical Inference
Test Items
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The standard error of equating quantifies the variability in the estimation of an equating function. Because common items for deriving equated scores are treated as fixed, the only source of variability typically considered arises from the estimation of common-item parameters from responses of samples of examinees. Use of alternative, equally appropriate anchor sets results in different equating transformations, even when standard errors of common-item parameter estimates are negligible. A bootstrap approximation for quantifying the variability due to common-item selection is derived for a statewide assessment assuming random selection of common items from a large hypothetical item pool. The standard error of equating and the error due to common-item selection constitute only a small fraction of the variability for individual examinee scores. For group means, other sources of error shrink as sample size increases; unaffected by sample size, error due to common-item selection may become the dominant source of variability.
ISSN:0895-7347
1532-4818
DOI:10.1080/08957347.2013.853069