The compliance of head-mounted industrial PPE by using deep learning object detectors

• Published in: Scientific reports 2022-09, Vol.12 (1), p.16347-10, Article 16347
• Main Authors: Isailovic, Velibor, Peulic, Aleksandar, Djapan, Marko, Savkovic, Marija, Vukicevic, Arso M.
• Format: Article
• Language: English
• Subjects: 639/705/117; 639/705/258; 639/705/794; Algorithms; Compliance; Computer vision; Data collection; Deep Learning; Humanities and Social Sciences; Humans; Industry; multidisciplinary; Personal Protective Equipment; Protective equipment; Science; Science (multidisciplinary); Technology
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-022-20282-9

The compliance of industrial personal protective equipment (PPE) still represents a challenging problem considering size of industrial halls and number of employees that operate within them. Since there is a high variability of PPE types/designs that could be used for protecting various body parts and physiological functions, this study was focused on assessing the use of computer vision algorithms to automate the compliance of head-mounted PPE. As a solution, we propose a pipeline that couples the head ROI estimation with the PPE detection. Compared to alternative approaches, it excludes false positive cases while it largely speeds up data collection and labeling. A comprehensive dataset was created by merging public datasets PictorPPE and Roboflow with author’s collected images, containing twelve different types of PPE was used for the development and assessment of three deep learning architectures (Faster R-CNN, MobileNetV2-SSD and YOLOv5)—which in literature were studied only separately. The obtained results indicated that various deep learning architectures reached different performances for the compliance of various PPE types—while the YOLOv5 slightly outperformed considered alternatives (precision 0.920 ± 0.147, and recall 0.611 ± 0.287). It is concluded that further studies on the topic should invest more effort into assessing various deep learning architectures in order to objectively find the optimal ones for the compliance of a particular PPE type. Considering the present technological and data privacy barriers, the proposed solution may be applicable for the PPE compliance at certain checkpoints where employees can confirm their identity.