Achieving multi-modal brain disease diagnosis performance using only single-modal images through generative AI

• Published in: Communications engineering 2024-07, Vol.3 (1), p.96-13, Article 96
• Main Authors: Sun, Kaicong, Zhang, Yuanwang, Liu, Jiameng, Yu, Ling, Zhou, Yan, Xie, Fang, Guo, Qihao, Zhang, Han, Wang, Qian, Shen, Dinggang
• Format: Article
• Language: English
• Subjects: 631/1647/245/1628; 631/1647/245/2092; 692/700; Ablation; Brain; Brain diseases; Classification; Cognitive ability; Datasets; Diagnosis; Engineering; Generative artificial intelligence; Machine learning; Medical diagnosis; Modal data; Representations; Synthesis; Training; Uncertainty
• ISSN: 2731-3395; 2731-3395
• DOI: 10.1038/s44172-024-00245-w

Brain disease diagnosis using multiple imaging modalities has shown superior performance compared to using single modality, yet multi-modal data is not easily available in clinical routine due to cost or radiation risk. Here we propose a synthesis-empowered uncertainty-aware classification framework for brain disease diagnosis. To synthesize disease-relevant features effectively, a two-stage framework is proposed including multi-modal feature representation learning and representation transfer based on hierarchical similarity matching. Besides, the synthesized and acquired modality features are integrated based on evidential learning, which provides diagnosis decision and also diagnosis uncertainty. Our framework is extensively evaluated on five datasets containing 3758 subjects for three brain diseases including Alzheimer’s disease (AD), subcortical vascular mild cognitive impairment (MCI), and O[6]-methylguanine-DNA methyltransferase promoter methylation status for glioblastoma, achieving 0.950 and 0.806 in area under the ROC curve on ADNI dataset for discriminating AD patients from normal controls and progressive MCI from static MCI, respectively. Our framework not only achieves quasi-multimodal performance although using single-modal input, but also provides reliable diagnosis uncertainty. Kaicong Sun and colleagues design a generative uncertainty-aware AI framework to facilitate brain disease diagnosis using single-modal input. Validated on five datasets comprising thousands of subjects, this approach shows promising results close to using multi-modal input across three types of brain disease.