A classification for complex imbalanced data in disease screening and early diagnosis

• Published in: Statistics in medicine 2022-08, Vol.41 (19), p.3679-3695
• Main Authors: Li, Yiming, Hsu, Wei‐Wen
• Format: Article
• Language: English
• Subjects: Algorithms; Alzheimer's disease; AUC; brain imaging data; class imbalance; Classification; Early Diagnosis; group LASSO; Humans; Machine Learning; Medical screening; Research Design
• ISSN: 0277-6715; 1097-0258
• DOI: 10.1002/sim.9442

Imbalanced classification has drawn considerable attention in the statistics and machine learning literature. Typically, traditional classification methods often perform poorly when a severely skewed class distribution is observed, not to mention under a high‐dimensional longitudinal data structure. Given the ubiquity of big data in modern health research, it is expected that imbalanced classification in disease diagnosis may encounter an additional level of difficulty that is imposed by such a complex data structure. In this article, we propose a nonparametric classification approach for imbalanced data in longitudinal and high‐dimensional settings. Technically, the functional principal component analysis is first applied for feature extraction under the longitudinal structure. The univariate exponential loss function coupled with group LASSO penalty is then adopted into the classification procedure in high‐dimensional settings. Along with a good improvement in imbalanced classification, our approach provides a meaningful feature selection for interpretation while enjoying a remarkably lower computational complexity. The proposed method is illustrated on the real data application of Alzheimer's disease early detection and its empirical performance in finite sample size is extensively evaluated by simulations.