A Systematic Review and Meta-Analysis of the Diagnostic Accuracy of the Advanced Clinical Solutions Word Choice Test as a Performance Validity Test

• Published in: Neuropsychology review 2021-06, Vol.31 (2), p.349-359
• Main Authors: Bernstein, Matthew T., Resch, Zachary J., Ovsiew, Gabriel P., Soble, Jason R.
• Format: Article
• Language: English
• Subjects: Accuracy; Biomedical and Life Sciences; Biomedicine; Meta-analysis; Neurology; Neuropsychology; Neurosciences; Population studies; Review; Systematic review; Validity
• ISSN: 1040-7308; 1573-6660
• DOI: 10.1007/s11065-020-09468-y

Thorough assessment of performance validity has become an established standard of practice in neuropsychological assessment. While there has been a large focus on the development and cross-validation of embedded performance validity tests (PVTs) in recent years, new freestanding PVTs have also been developed, including the Word Choice Test (WCT) as part of the Advanced Clinical Solutions Effort System. And, while the WCT’s general utility for identifying invalid performance has been demonstrated in the ensuing decade since its initial publication, optimal cut-scores and associated psychometric properties have varied widely across studies. This study sought to synthesize the existing diagnostic accuracy literature regarding the WCT via a systematic review and to conduct a meta-analysis to determine the performance validity cut-score that best maximizes sensitivity while maintaining acceptable specificity. A systematic search of the literature resulted in 14 studies for synthesis, with eight of those available for meta-analysis. Meta-analytic results revealed an optimal cut-score of ≤ 42 with 54% sensitivity and 93% specificity for identifying invalid neuropsychological test performance. Collectively, the WCT demonstrated adequate diagnostic accuracy as a PVT across a variety of populations. Recommendations for future studies are also provided.