Now You See Them, Now You Do Not: The Influence of Indicator-Factor Ratio on Support for Assessment Center Dimensions

The inability of assessment center (AC) researchers to find admissible solutions for confirmatory factor analytic (CFA) models that include dimensions has led some to conclude that ACs do not measure dimensions at all. This study investigated whether increasing the indicator–factor ratio facilitates...

Full description

Saved in:
Bibliographic Details
Published in:Personnel psychology 2013-12, Vol.66 (4), p.1009-1047
Main Authors: Monahan, Elizabeth L., Hoffman, Brian J., Lance, Charles E., Jackson, Duncan J. R., Foster, Mark R.
Format: Article
Language:English
Subjects:
Assessment Centers (Personnel)
Behavior Rating Scales
Comparative analysis
Correlation analysis
Discriminant analysis
Mathematical models
Mathematical problems
Organizational behavior
Studies
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The inability of assessment center (AC) researchers to find admissible solutions for confirmatory factor analytic (CFA) models that include dimensions has led some to conclude that ACs do not measure dimensions at all. This study investigated whether increasing the indicator–factor ratio facilitates the achievement of convergent and admissible CFA solutions in 2 independent ACs. Results revealed that, when models specify multiple behavioral checklist items as manifest indicators of each latent dimension, all of the AC CFA models tested were identified and returned proper solutions. When armed with the ability to undertake a full set of model comparisons using model fit rather than solution convergence and admissibility as comparative criteria, we found clear evidence for modest dimension effects. These results suggest that the frequent failure to find dimensions in models of the internal structure of ACs is a methodological artifact and that one approach to increase the likelihood for reaching a proper solution is to increase the number of manifest indicators for each dimension factor. In addition, across exercise dimension ratings and the overall assessment rating were both strongly correlated with dimension and exercise factors, indicating that regardless of how an AC is scored, exercise variance will continue to play a key role in the scoring of ACs.
ISSN:0031-5826
1744-6570
DOI:10.1111/peps.12049