Enhancing Smart City Safety and Utilizing AI Expert Systems for Violence Detection

• Published in: Future internet 2024-01, Vol.16 (2), p.50
• Main Authors: Kumar, Pradeep, Shih, Guo-Liang, Guo, Bo-Lin, Nagi, Siva Kumar, Manie, Yibeltal Chanie, Yao, Cheng-Kai, Arockiyadoss, Michael Augustine, Peng, Peng-Chun
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Artificial intelligence; Cities; Classification; Cutlery; Data collection; Datasets; Edge computing; Emergency response; expert system; Expert systems; image-to-image stable diffusion; Internet; Knives; Model accuracy; Object recognition; Pose estimation; Real time; real-time application; Safety and security measures; Small arms; Smart cities; smart city; Synthetic data; Violence; violence detection
• ISSN: 1999-5903; 1999-5903
• DOI: 10.3390/fi16020050

Violent attacks have been one of the hot issues in recent years. In the presence of closed-circuit televisions (CCTVs) in smart cities, there is an emerging challenge in apprehending criminals, leading to a need for innovative solutions. In this paper, the propose a model aimed at enhancing real-time emergency response capabilities and swiftly identifying criminals. This initiative aims to foster a safer environment and better manage criminal activity within smart cities. The proposed architecture combines an image-to-image stable diffusion model with violence detection and pose estimation approaches. The diffusion model generates synthetic data while the object detection approach uses YOLO v7 to identify violent objects like baseball bats, knives, and pistols, complemented by MediaPipe for action detection. Further, a long short-term memory (LSTM) network classifies the action attacks involving violent objects. Subsequently, an ensemble consisting of an edge device and the entire proposed model is deployed onto the edge device for real-time data testing using a dash camera. Thus, this study can handle violent attacks and send alerts in emergencies. As a result, our proposed YOLO model achieves a mean average precision (MAP) of 89.5% for violent attack detection, and the LSTM classifier model achieves an accuracy of 88.33% for violent action classification. The results highlight the model’s enhanced capability to accurately detect violent objects, particularly in effectively identifying violence through the implemented artificial intelligence system.