Visual defect obfuscation based self-supervised anomaly detection

• Published in: Scientific reports 2024-08, Vol.14 (1), p.18872-13
• Main Authors: Park, YeongHyeon, Kang, Sungho, Kim, Myung Jin, Lee, Yeonho, Kim, Hyeong Seok, Yi, Juneho
• Format: Article
• Language: English
• Subjects: 639/166/987; 639/705/1042; 639/705/117; Attention; Automation; Datasets; Defective products; Humanities and Social Sciences; Laboratory tests; Manufacturing; Methods; multidisciplinary; Product quality; Science; Science (multidisciplinary); Vision systems; Visual perception
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-024-69698-5

Due to scarcity of anomaly situations in the early manufacturing stage, an unsupervised anomaly detection (UAD) approach is widely adopted which only uses normal samples for training. This approach is based on the assumption that the trained UAD model will accurately reconstruct normal patterns but struggles with unseen anomalies. To enhance the UAD performance, reconstruction-by-inpainting based methods have recently been investigated, especially on the masking strategy of suspected defective regions. However, there are still issues to overcome: (1) time-consuming inference due to multiple masking, (2) output inconsistency by random masking, and (3) inaccurate reconstruction of normal patterns for large masked areas. Motivated by this, this study proposes a novel reconstruction-by-inpainting method, dubbed Excision And Recovery (EAR), that features single deterministic masking based on the ImageNet pre-trained DINO-ViT and visual obfuscation for hint-providing. Experimental results on the MVTec AD dataset show that deterministic masking by pre-trained attention effectively cuts out suspected defective regions and resolves the aforementioned issues 1 and 2. Also, hint-providing by mosaicing proves to enhance the performance than emptying those regions by binary masking, thereby overcomes issue 3. The proposed approach achieves a high performance without any change of the model structure. Promising results are shown through laboratory tests with public industrial datasets. To suggest EAR be possibly adopted in various industries as a practically deployable solution, future steps include evaluating its applicability in relevant manufacturing environments.