Likability and Similarity as Potential Sources of Predictor-Related Criterion Bias in Validation Research

Previous research on the effects of bias in criterion-related validation research has typically involved the use of statistical corrections for halo, leniency, and/or central tendency. We present arguments that likability and similarity of raters to ratees may constitute a form of predictor-related...

Full description

Saved in:
Bibliographic Details
Published in:Organizational behavior and human decision processes 1996-12, Vol.68 (3), p.272-286
Main Authors: Schmitt, Neal, Pulakos, Elaine D., Nason, Earl, Whitney, David J.
Format: Article
Language:English
Subjects:
Bias
Biological and medical sciences
Criteria
Fundamental and applied biological sciences. Psychology
Occupational psychology
Organizational behavior
Orientation. Selection. Evaluation
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Regression analysis
Statistical methods
Studies
Validity
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Previous research on the effects of bias in criterion-related validation research has typically involved the use of statistical corrections for halo, leniency, and/or central tendency. We present arguments that likability and similarity of raters to ratees may constitute a form of predictor-related criterion bias. One cannot investigate this form of bias without clear understanding of method, predictor, and criterion constructs and careful direct measurement of each. Measurement and theorizing of method constructs is rarely, if ever, undertaken in criterion-related validation work. The results of a criterion-related validation of the use of quantitative and verbal ability and interview and role-play simulations to predict the performance of 372 federal investigative agents are reported. Using the all-Y LISREL model (Williams & Anderson, 1994), we found that likability and similarity factors were related to interview and role play measures. However, none of these potential "biases" affected both predictor and criterion constructs, hence there was no effect on the estimates of the relationships between the predictors and criteria. Limitations with respect to the generalizability of these results to criterion-related research in which performance data are not as carefully collected as well as advantages and disadvantages of more traditional regression and correlational analyses are discussed.
ISSN:0749-5978
1095-9920
DOI:10.1006/obhd.1996.0105