Deep labeller: automatic bounding box generation for synthetic violence detection datasets

• Published in: Multimedia tools and applications 2024, Vol.83 (4), p.10717-10734
• Main Authors: Nadeem, Muhammad Shahroz, Kurugollu, Fatih, Saravi, Sara, Atlam, Hany F., Franqueira, Virginia N. L.
• Format: Article
• Language: English
• Subjects: Computer Communication Networks; Computer Science; Data Structures and Information Theory; Multimedia Information Systems; Special Purpose and Application-Based Systems
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-023-15621-5

Manually labelling datasets for training violence detection systems is time-consuming, expensive, and labor-intensive. Mind wandering, boredom, and short attention span can also cause labelling errors. Moreover, collecting and distributing sensitive images containing violence has ethical implications. Automation is the future for labelling sensitive image datasets. Deep labeller is a two-stage Deep Learning (DL) method that uses pre-trained DL object detection methods on MS-COCO for automatic labelling. The Deep Labeller method labels violent and nonviolent images in WVD and USI. In stage 1, WVD generates weak labels using synthetic images. In stage 2, the Deep labeller method is retrained on weak labels. USI dataset is used to test our method on real-world violence. Deep labeller generated weak and strong labels with an IoU of 0.80036 in stage 1 and 0.95 in stage 2 on the WVD. Automatically generated labels. To test our method’s generalisation power, violent and nonviolent image labels on USI dataset had a mean IoU of 0.7450.