Longitudinal Ensemble Integration for sequential classification with multimodal data

Effectively modeling multimodal longitudinal data is a pressing need in various application areas, especially biomedicine. Despite this, few approaches exist in the literature for this problem, with most not adequately taking into account the multimodality of the data. In this study, we developed mu...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-11
Main Authors: Susman, Aviad, Krishnamurthy, Rupak, Yan Chak Li, Olaimat, Mohammad, Bozdag, Serdar, Varghese, Bino, Sheikh-Bahaei, Nasim, Pandey, Gaurav
Format: Article
Language:English
Subjects:
Classification
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Effectively modeling multimodal longitudinal data is a pressing need in various application areas, especially biomedicine. Despite this, few approaches exist in the literature for this problem, with most not adequately taking into account the multimodality of the data. In this study, we developed multiple configurations of a novel multimodal and longitudinal learning framework, Longitudinal Ensemble Integration (LEI), for sequential classification. We evaluated LEI's performance, and compared it against existing approaches, for the early detection of dementia, which is among the most studied multimodal sequential classification tasks. LEI outperformed these approaches due to its use of intermediate base predictions arising from the individual data modalities, which enabled their better integration over time. LEI's design also enabled the identification of features that were consistently important across time for the effective prediction of dementia-related diagnoses. Overall, our work demonstrates the potential of LEI for sequential classification from longitudinal multimodal data.
ISSN:2331-8422