Situational Bandwidth and the Criterion-Related Validity of Assessment Center Ratings: Is Cross-Exercise Convergence Always Desirable?

This research examines the relationship between the construct and criterion-related validity of assessment centers (ACs) based on how convergence of dimension ratings across AC exercises affects their ability to predict managerial performance. According to traditional multitrait-multimethod perspect...

Full description

Saved in:
Bibliographic Details
Published in:Journal of applied psychology 2014-03, Vol.99 (2), p.282-295
Main Authors: Speer, Andrew B, Christiansen, Neil D, Goffin, Richard D, Goff, Maynard
Format: Article
Language:English
Subjects:
Adult
Assessment
Assessment Centers
Behavioral Assessment
Biological and medical sciences
Candidates
Convergence
Correlation
Data Interpretation, Statistical
Employee Performance Appraisal - standards
Estimation
Evaluation
Exercise
Female
Fundamental and applied biological sciences. Psychology
Human
Humans
Male
Management Personnel
Management theory
Measurement
Measurement techniques
Middle Aged
Observation Methods
Occupational psychology
Organizational behavior
Orientation. Selection. Evaluation
Performance appraisal
Personnel Evaluation
Personnel Selection - standards
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics - standards
Rating
Ratings & rankings
Staff Development - standards
Statistical Validity
Validation studies
Validity
Viewpoint
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This research examines the relationship between the construct and criterion-related validity of assessment centers (ACs) based on how convergence of dimension ratings across AC exercises affects their ability to predict managerial performance. According to traditional multitrait-multimethod perspective, a high degree of convergence represents more reliable measurement and has the potential for better validity. In contrast, the concept of situational bandwidth suggests that behavior assessed under a dissimilar set of circumstances should result in a more comprehensive assessment of a candidate's tendencies even though ratings are less likely to show high convergence. To test these opposing viewpoints, data from 3 operational ACs were obtained along with experts' evaluations of exercise characteristics and supervisors' ratings of candidates' managerial performance. Across the 3 samples, AC ratings taken from exercises with dissimilar demands had higher estimates of criterion-related validity than ratings taken from similar exercises, even though the same dimension-different exercise correlations were substantially higher between similar exercises. Composites of ratings high in convergence did not emerge as better predictors of managerial performance, and validity particularly suffered when derived from ratings that converged as a result of exercises with similar demands. Implications for AC design are discussed.
ISSN:0021-9010
1939-1854
DOI:10.1037/a0035213