FenceTalk: Exploring False Negatives in Moving Object Detection

Deep learning models are often trained with a large amount of labeled data to improve the accuracy for moving object detection in new fields. However, the model may not be robust enough due to insufficient training data in the new field, resulting in some moving objects not being successfully detect...

Full description

Saved in:
Bibliographic Details
Published in:Algorithms 2023-10, Vol.16 (10), p.481
Main Authors: Lin, Yun-Wei, Liu, Yuh-Hwan, Lin, Yi-Bing, Hong, Jian-Chang
Format: Article
Language:English
Subjects:
Accuracy
Cameras
Deep learning
Detectors
Evaluation
image object detection
Internet of Things
Moving object recognition
Neural networks
Recall
Sensors
structural similarity index measure (SSIM)
Surveillance
Video compression
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep learning models are often trained with a large amount of labeled data to improve the accuracy for moving object detection in new fields. However, the model may not be robust enough due to insufficient training data in the new field, resulting in some moving objects not being successfully detected. Training with data that is not successfully detected by the pre-trained deep learning model can effectively improve the accuracy for the new field, but it is costly to retrieve the image data containing the moving objects from millions of images per day to train the model. Therefore, we propose FenceTalk, a moving object detection system, which compares the difference between the current frame and the background image based on the structural similarity index measure (SSIM). FenceTalk automatically selects suspicious images with moving objects that are not successfully detected by the Yolo model, so that the training data can be selected at a lower labor cost. FenceTalk can effectively define and update the background image in the field, reducing the misjudgment caused by changes in light and shadow, and selecting images containing moving objects with an optimal threshold. Our study has demonstrated its performance and generality using real data from different fields. For example, compared with the pre-trained Yolo model using the MS COCO dataset, the overall recall of FenceTalk increased from 72.36% to 98.39% for the model trained with the data picked out by SSIM. The recall of FenceTalk, combined with Yolo and SSIM, can reach more than 99%.
ISSN:1999-4893
1999-4893
DOI:10.3390/a16100481