Better Together: Combining Different Handwriting Input Sources Improves Dementia Screening

• Main Authors: Hosseini-Kivanani, Nina, Salobrar-Garcia, Elena, Elvira-Hurtado, Lorena, Lopez-Cuenca, Ines, de Hoz, Rosa, Ramirez, Jose M., Gil, Pedro, Salas, Mario, Schommer, Christoph, Leiva, Luis A.
• Format: Conference Proceeding
• Language: English
• Subjects: Cognition; Convolutional Neural Networks; Data augmentation; Data models; deep feature concatenation; Deep Learning; dementia; Feature extraction; image processing; Machine learning; Medical services; Memory management
• ISSN: 2325-3703
• DOI: 10.1109/e-Science58273.2023.10254799

Alzheimer's disease (AD) is a cognitive disorder, marked by memory loss and impaired reasoning, that requires early detection methods to better manage and potentially slow down the disease's progression. Recent advances in machine learning have offered new possibilities for AD detection using handwriting analysis, however previous work has considered only one type of input source, e.g. clock or pentagon drawings. Here we propose to develop an efficient method for detecting AD's early symptoms using Deep Feature Concatenation (DFC) models considering multiple handwriting sources: pentagon drawings, self-reported sentences, and signatures. Substantial performance improvements were observed when considering all input sources together with data augmentation techniques. For example, classification accuracy increased from 60% (best model, without data augmentation) to 80% (DFC and data augmentation). Our findings show that the use of diverse input sources can lead to an efficient and cost-effective method for early AD detection. Looking forward into the future, our study highlights the potential of DFC in supporting home-based healthcare diagnoses which is a crucial step in integrating artificial intelligence into healthcare practices.