The Variability of Criterion-Related Validity Estimates Among Interviewers and Interview Panels

The authors examined differences in criterion‐related validity estimates among ratings from individual interviewers and interview panels within a structured interview. Senior non‐commissioned officers (NCOs) in the U.S. Army (N=64) conducted panel interviews with 944 junior NCOs during a concurrent...

Full description

Saved in:
Bibliographic Details
Published in:International journal of selection and assessment 2006-09, Vol.14 (3), p.193-205
Main Authors: Van Iddekinge, Chad H., Sager, Christopher E., Burnfield, Jennifer L., Heffner, Tonia S.
Format: Article
Language:English
Subjects:
Armed forces
Criteria
Differences
Estimating techniques
Interviews
Studies
Validity
Variance analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The authors examined differences in criterion‐related validity estimates among ratings from individual interviewers and interview panels within a structured interview. Senior non‐commissioned officers (NCOs) in the U.S. Army (N=64) conducted panel interviews with 944 junior NCOs during a concurrent validation project. Analysis of the data revealed considerable variation in interviewer validity coefficients in relation to multiple performance criteria. Results also indicated the importance of adopting a multivariate perspective when evaluating interviewer validity differences in that the amount of variation in validity coefficients differed both by interview dimension and criterion. A similar pattern of findings emerged when analyses were performed on ratings averaged within interview panel. Nonetheless, when meta‐analysis was used to estimate the amount of true variance in interviewer‐ and panel‐level validity coefficients, most or all of the variance for some interview‐criterion combinations appeared to be due to statistical artifacts.
ISSN:0965-075X
1468-2389
DOI:10.1111/j.1468-2389.2006.00352.x