Attention-based deep learning for breast lesions classification on contrast enhanced spectral mammography: a multicentre study

• Published in: British journal of cancer 2023-03, Vol.128 (5), p.793-804
• Main Authors: Mao, Ning, Zhang, Haicheng, Dai, Yi, Li, Qin, Lin, Fan, Gao, Jing, Zheng, Tiantian, Zhao, Feng, Xie, Haizhu, Xu, Cong, Ma, Heng
• Format: Article
• Language: English
• Subjects: 692/4028/67/1347; 692/699/67/2321; Biomedical and Life Sciences; Biomedicine; Breast; Breast - diagnostic imaging; Breast Neoplasms - pathology; Cancer Research; Classification; Deep Learning; Drug Resistance; Epidemiology; Female; Humans; Lesions; Mammography; Mammography - methods; Molecular Medicine; Neural networks; Neural Networks, Computer; Oncology; Radiomics; Sensitivity and Specificity
• ISSN: 0007-0920; 1532-1827
• DOI: 10.1038/s41416-022-02092-y

Background This study aims to develop an attention-based deep learning model for distinguishing benign from malignant breast lesions on CESM. Methods Preoperative CESM images of 1239 patients, which were definitely diagnosed on pathology in a multicentre cohort, were divided into training and validation sets, internal and external test sets. The regions of interest of the breast lesions were outlined manually by a senior radiologist. We adopted three conventional convolutional neural networks (CNNs), namely, DenseNet 121, Xception, and ResNet 50, as the backbone architectures and incorporated the convolutional block attention module (CBAM) into them for classification. The performance of the models was analysed in terms of the receiver operating characteristic (ROC) curve, accuracy, the positive predictive value (PPV), the negative predictive value (NPV), the F1 score, the precision recall curve (PRC), and heat maps. The final models were compared with the diagnostic performance of conventional CNNs, radiomics models, and two radiologists with specialised breast imaging experience. Results The best-performing deep learning model, that is, the CBAM-based Xception, achieved an area under the ROC curve (AUC) of 0.970, a sensitivity of 0.848, a specificity of 1.000, and an accuracy of 0.891 on the external test set, which was higher than those of other CNNs, radiomics models, and radiologists. The PRC and the heat maps also indicated the favourable predictive performance of the attention-based CNN model. The diagnostic performance of two radiologists improved with deep learning assistance. Conclusions Using an attention-based deep learning model based on CESM images can help to distinguishing benign from malignant breast lesions, and the diagnostic performance of radiologists improved with deep learning assistance.