Machine Learning to Classify Suicidal Thoughts and Behaviors: Implementation Within the Common Data Elements Used by the Military Suicide Research Consortium

• Published in: Clinical psychological science 2021-05, Vol.9 (3), p.467-481
• Main Authors: Littlefield, Andrew K., Cooke, Jeffrey T., Bagge, Courtney L., Glenn, Catherine R., Kleiman, Evan M., Jacobucci, Ross, Millner, Alexander J., Steinley, Douglas
• Format: Article
• Language: English
• ISSN: 2167-7026; 2167-7034
• DOI: 10.1177/2167702620961067

Suicide rates among military-connected populations have increased over the past 15 years. Meta-analytic studies indicate prediction of suicide outcomes is lacking. Machine-learning approaches have been promoted to enhance classification models for suicide-related outcomes. In the present study, we compared the performance of three primary machine-learning approaches (i.e., elastic net, random forests, stacked ensembles) and a traditional statistical approach, generalized linear modeling (i.e., logistic regression), to classify suicide thoughts and behaviors using data from the Military Suicide Research Consortium’s Common Data Elements (CDE; n = 5,977–6,058 across outcomes). Models were informed by (a) selected items from the CDE or (b) factor scores based on exploratory and confirmatory factor analyses on the selected CDE items. Results indicated similar classification performance across models and sets of features. In this study, we suggest the need for robust evidence before adopting more complex classification models and identify measures that are particularly relevant in classifying suicide-related outcomes.