Study on the classification of benign and malignant breast lesions using a multi-sequence breast MRI fusion radiomics and deep learning model

• Published in: European journal of radiology Open 2024-12, Vol.13, p.100607, Article 100607
• Main Authors: Wang, Wenjiang, Li, Jiaojiao, Wang, Zimeng, Liu, Yanjun, Yang, Fei, Cui, Shujun
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Breast Cancer; Deep Learning; Medical Imaging
• ISSN: 2352-0477; 2352-0477
• DOI: 10.1016/j.ejro.2024.100607

To develop a multi-modal model combining multi-sequence breast MRI fusion radiomics and deep learning for the classification of benign and malignant breast lesions, to assist clinicians in better selecting treatment plans. A total of 314 patients who underwent breast MRI examinations were included. They were randomly divided into training, validation, and test sets in a ratio of 7:1:2. Subsequently, features of T1-weighted images (T1WI), T2-weighted images (T2WI), and dynamic contrast-enhanced MRI (DCE-MRI) were extracted using the convolutional neural network ResNet50 for fusion, and then combined with radiomic features from the three sequences. The following models were established: T1 model, T2 model, DCE model, DCE_T1_T2 model, and DCE_T1_T2_rad model. The performance of the models was evaluated by the area under the receiver operating characteristic (ROC) curve (AUC), accuracy, sensitivity, specificity, positive predictive value, and negative predictive value. The differences between the DCE_T1_T2_rad model and the other four models were compared using the Delong test, with a P-value < 0.05 considered statistically significant. The five models established in this study performed well, with AUC values of 0.53 for the T1 model, 0.62 for the T2 model, 0.79 for the DCE model, 0.94 for the DCE_T1_T2 model, and 0.98 for the DCE_T1_T2_rad model. The DCE_T1_T2_rad model showed statistically significant differences (P < 0.05) compared to the other four models. The use of a multi-modal model combining multi-sequence breast MRI fusion radiomics and deep learning can effectively improve the diagnostic performance of breast lesion classification. •The multimodal model combined the radiomics features and deep learning features from the three sequences of T1WI, T2WI, and DCE-MRI of breast MRI.•The dataset includes various breast diseases, providing broader applicability.