A validity study of a work sample test of leadership behavior using supervisor and subordinate ratings as criteria

• Published in: Scandinavian journal of psychology 2024-02, Vol.65 (1), p.129-135
• Main Authors: Sjöberg, Anders, Grill, Martin
• Format: Article
• Language: English
• Subjects: Applied Psychology; assessment center; consideration; influencing others; Leadership behaviors; Managerial behaviors; planning; predictive validity; Psychology; psykologi; subordinate ratings; supervisor ratings; Supervisors; Tillämpad psykologi; Validity; work sample test
• ISSN: 0036-5564; 1467-9450; 1467-9450
• DOI: 10.1111/sjop.12954

Work sample tests gather information about behavior that is consistent with the behavior being predicted. This criterion‐related validity study examines whether a work sample test can predict behaviors more than 6 months later among managers (N = 127) in a large municipal organization. Ratings from both the subordinates (SOR) and supervisors (SVR) of the managers were used as criteria for the leadership dimensions of Influencing others, Consideration, and Planning. In total, six hypotheses were tested. The results were corrected for range restriction in the predictors and for unreliability in the criteria. The hypothesis that the work sample test score of Consideration predicted subordinates' ratings of Consideration received full support (ρ¯ = 0.33; CI [0.06–0.56]). The Consideration work sample test score also showed a positive relationship with supervisor ratings of Consideration (ρ¯ = 0.22; CI [−0.01 to 0.43]), although the confidence interval includes zero. No significant criterion‐related validity was found for Influencing others or Planning. Given the results, the work sample test can primarily be used to predict Consideration. The results are discussed, and suggestions for further research are provided.