CSDD-Net: A cross semi-supervised dual-feature distillation network for industrial defect detection

• Published in: Knowledge-based systems 2024-12, Vol.306, p.112751, Article 112751
• Main Authors: Zhou, Mingle, Su, Zhanzhi, Li, Min, Wang, Yingjie, Li, Gang
• Format: Article
• Language: English
• Subjects: Adaptive Distillation Loss; Closed-Loop Aggregation; Double-Feature Distillation Network; Spectral Linear Attention
• ISSN: 0950-7051
• DOI: 10.1016/j.knosys.2024.112751

•We proposed a novel cross semi-supervised dual-feature distillation network (CSDD-Net) to achieve efficient defect detection based on partially labeled data.•We design dual interaction and ghost linear attention structures to force the network to focus on the local detail texture in the global feature and perceive the global semantics in the local feature.•We propose a cross-layer feature interactive closed-loop cross-aggregation network (CLCA-Net) and a dynamic adaptive distillation loss function to learn the defect location information with large changes in scale. Detecting defects in industrial products is crucial to the strict quality control of products. Most current methods focus on supervised learning, relying on large-scale labeled samples. However, the forms of defects in industrial scenarios vary, and the data collection cost is high, which makes it difficult to meet the high requirements of massive labeled data. Therefore, we propose a Cross Semi-Supervised Dual-Feature Distillation Network (CSDD-Net), which aims to cross-use supervised and semi-supervised networks to learn rich feature representations and the distribution of large-scale features, respectively. CSDD-Net can transfer the defect feature distribution learned on partially labeled data in supervised branch to unsupervised branch, achieving simultaneous modeling and distillation based on partially labeled data. Firstly, this paper proposes a cross-local-global feature extraction network. By designing double interaction and ghost linear attention structure, it aims to force the network to be able to focus on local detail texture in global features and local features to perceive global semantics. Secondly, this paper proposes a Closed-Loop Cross-Aggregation Network (CLCA-Net), which considers deep and shallow semantics and fine-grained information. Thirdly, this paper designs a dynamic adaptive distillation loss, which could automatically adjust a more suitable regression loss function according to the defect characteristics, ensuring that the model could accurately locate and regress defects of various scales. Finally, this paper proposes a Glass Bottleneck defect dataset and verifies the feasibility of CSDD-Net in practical industrial applications. CSDD-Net achieved mAP@.5 of 80.41%, 76.42%, and 97.12% on the Glass Bottleneck, Wood, and Aluminum datasets with only 13.5 GFLOPs.