RNN-based longitudinal analysis for diagnosis of Alzheimer’s disease

• Published in: Computerized medical imaging and graphics 2019-04, Vol.73, p.1-10
• Main Authors: Cui, Ruoxuan, Liu, Manhua
• Format: Article
• Language: English
• Subjects: Abnormalities; Alzheimer's disease; Alzheimer’s disease diagnosis; Artificial neural networks; Brain; Classification; Classifiers; Cognitive ability; Convolutional neural networks (CNNs); Diagnosis; Disease control; Feature extraction; Image analysis; Image classification; Image processing; Impairment; Learning; Longitudinal analysis; Magnetic resonance images; Magnetic resonance imaging; Medical diagnosis; Medical imaging; Neural networks; Neurodegenerative diseases; Neuroimaging; Neurology; Recurrent neural network; Recurrent neural networks
• ISSN: 0895-6111; 1879-0771
• DOI: 10.1016/j.compmedimag.2019.01.005

•Propose an AD classification framework by combining CNN and RNN for longitudinal analysis of structural MR images.•CNN is to learn the spatial features, while RNN is built with cascaded BGRU layers to extract the longitudinal features.•The method can learn the spatial and longitudinal features from longitudinal images of variable length for classification.•Results on ADNI database have demonstrated the effectiveness of the proposed method and its superiority. Alzheimer's disease (AD) is an irreversible neurodegenerative disorder with progressive impairment of memory and other mental functions. Magnetic resonance images (MRI) have been widely used as an important imaging modality of brain for AD diagnosis and monitoring the disease progression. The longitudinal analysis of sequential MRIs is important to model and measure the progression of the disease along the time axis for more accurate diagnosis. Most existing methods extracted the features capturing the morphological abnormalities of brain and their longitudinal changes using MRIs and then designed a classifier to discriminate different groups. However, these methods have several limitations. First, since the feature extraction and classifier model are independent, the extracted features may not capture the full characteristics of brain abnormalities related to AD. Second, longitudinal MR images may be missing at some time points for some subjects, which results in difficulties for extraction of consistent features for longitudinal analysis. In this paper, we present a classification framework based on combination of convolutional and recurrent neural networks for longitudinal analysis of structural MR images in AD diagnosis. First, Convolutional Neural Networks (CNN) is constructed to learn the spatial features of MR images for the classification task. After that, recurrent Neural Networks (RNN) with cascaded three bidirectional gated recurrent units (BGRU) layers is constructed on the outputs of CNN at multiple time points for extracting the longitudinal features for AD classification. Instead of independently performing feature extraction and classifier training, the proposed method jointly learns the spatial and longitudinal features and disease classifier, which can achieve optimal performance. In addition, the proposed method can model the longitudinal analysis using RNN from the imaging data at various time points. Our method is evaluated with the longitudinal T1-weighted MR images of 830 parti