Superpixel-based principal feature clustering annotation method for dual-phase microstructure segmentation

• Published in: Materials characterization 2024-12, Vol.218, p.114523, Article 114523
• Main Authors: Lin, Shuanglan, Xu, Lei, Guo, Zhixing, Zhang, Dingcheng, Zeng, Pangwei, Tang, Yuexin, Pei, Hongliang
• Format: Article
• Language: English
• Subjects: Automatical annotation; Deep learning; Microstructure segmentation; Superpixel segmentation
• ISSN: 1044-5803
• DOI: 10.1016/j.matchar.2024.114523

Metallographic analysis is one of the most commonly used techniques by materials scientists for studying metal materials. The deep learning methods, which have been widely applied in metallographic images analysis, demonstrate excellent performance in this task. However, the optimization of deep learning models often relies on a substantial amount of accurately labeled samples for effective supervision. To address this issue, this paper proposes a novel automatic annotation method based on brightness and spatial distribution which is suitable for deep learning-based segmentation of optical dual-phase metallographic microstructure. The proposed automatic annotated method includes the superpixel segmentation, principal feature extraction, and clustering algorithm therefore it is referred as the superpixel-based principal feature clustering annotation (SPFCA) method. SPFCA employs discriminative criteria similar to those used by metallurgists to differentiate between metallographic structures. Furthermore, it can mitigate the occasional errors inherent in manual annotation, leading to improved performance compared to models trained with expert annotations. Experimental validation was conducted using four self-built datasets with different image qualities to test the performance of models from different perspective. Initially, hyperparameter optimization for the SPFCA method tailored to our dataset was performed. Subsequently, SPFCA was utilized to guide the optimization of the convolutional neural network employed for segmentation. The results demonstrate that the segmentation model optimized with SPFCA guidance achieved an F1 score of 0.9226 in the single dataset without the need for manual labeling, surpassing the segmentation models optimized with expert annotations. [Display omitted] •The advancement of deep learning has facilitated the quantitative analysis of metallographic images.•We propose a novel annotation method suitable for learning-based segmentation in dual-phase microstructures.•Our method has a similar judgment mechnism with metallurgists distinguishing dual-phase microstructures.•This method operates without manual intervention and reduces errors that arise from the inaccuracy of experts.•The performance of the model, guided by our method, exceeds that of models trained with manually labeled data.