Momentary Depression Severity Prediction in Patients With Acute Depression Who Undergo Sleep Deprivation Therapy: Speech-Based Machine Learning Approach

• Published in: JMIR mental health 2024-12, Vol.11, p.e64578-e64578
• Main Authors: Hartnagel, Lisa-Marie, Emden, Daniel, Foo, Jerome C, Streit, Fabian, Witt, Stephanie H, Frank, Josef, Limberger, Matthias F, Schmitz, Sara E, Gilles, Maria, Rietschel, Marcella, Hahn, Tim, Ebner-Priemer, Ulrich W, Sirignano, Lea
• Format: Article
• Language: English
• Subjects: Adult; Automation; Classification; Clinical Communication, Electronic Consultation and Telehealth; Customization; Data collection; Datasets; Depression - diagnosis; Depression - psychology; Depression - therapy; Depression and Mood Disorders; Suicide Prevention; Depressive Disorder, Major - diagnosis; Depressive Disorder, Major - psychology; Depressive Disorder, Major - therapy; Ecological Momentary Assessment (EMA); Female; Health care; Humans; Longitudinal studies; Machine Learning; Male; Mental depression; mHealth for Screening; Middle Aged; Original Paper; Patients; Severity of Illness Index; Sleep deprivation; Sleep Deprivation - psychology; Sleep Monitoring, Sleep Quality, Sleep Disorders; Smartphones; Speech; Speech - physiology; Telehealth and Telemonitoring
• ISSN: 2368-7959; 2368-7959
• DOI: 10.2196/64578

Mobile devices for remote monitoring are inevitable tools to support treatment and patient care, especially in recurrent diseases such as major depressive disorder. The aim of this study was to learn if machine learning (ML) models based on longitudinal speech data are helpful in predicting momentary depression severity. Data analyses were based on a dataset including 30 inpatients during an acute depressive episode receiving sleep deprivation therapy in stationary care, an intervention inducing a rapid change in depressive symptoms in a relatively short period of time. Using an ambulatory assessment approach, we captured speech samples and assessed concomitant depression severity via self-report questionnaire over the course of 3 weeks (before, during, and after therapy). We extracted 89 speech features from the speech samples using the Extended Geneva Minimalistic Acoustic Parameter Set from the Open-Source Speech and Music Interpretation by Large-Space Extraction (audEERING) toolkit and the additional parameter speech rate. We aimed to understand if a multiparameter ML approach would significantly improve the prediction compared to previous statistical analyses, and, in addition, which mechanism for splitting training and test data was most successful, especially focusing on the idea of personalized prediction. To do so, we trained and evaluated a set of >500 ML pipelines including random forest, linear regression, support vector regression, and Extreme Gradient Boosting regression models and tested them on 5 different train-test split scenarios: a group 5-fold nested cross-validation at the subject level, a leave-one-subject-out approach, a chronological split, an odd-even split, and a random split. In the 5-fold cross-validation, the leave-one-subject-out, and the chronological split approaches, none of the models were statistically different from random chance. The other two approaches produced significant results for at least one of the models tested, with similar performance. In total, the superior model was an Extreme Gradient Boosting in the odd-even split approach (R²=0.339, mean absolute error=0.38; both P