Probabilistic Intersection-Over-Union for Training and Evaluation of Oriented Object Detectors

• Published in: IEEE transactions on image processing 2024-01, Vol.33, p.671-681
• Main Authors: Murrugarra-Llerena, Jeffri, Kirsten, Lucas N, Zeni, Luis Felipe, Jung, Claudio R
• Format: Article
• Language: English
• Subjects: Back propagation; Boxes; Customization; Detectors; Ill posed problems; Object recognition; Representations; Sensors; Similarity; Statistical analysis; Training
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2023.3348697

Oriented object detection is a challenging and relatively new problem. Most existing approaches are based on deep learning and explore Oriented Bounding Boxes (OBBs) to represent the objects. They are typically based on adaptations of traditional detectors that work with Horizontal Bounding Boxes (HBBs), which have been exploring IoU-like loss functions to regress the HBBs. However, extending this idea for OBBs is challenging due to complex formulations or requirement for customized backpropagation implementations. Furthermore, using OBBs presents limitations for irregular or roughly circular objects, since the definition of the ideal OBB is an ambiguous and ill-posed problem. In this work, we jointly tackle the problem of training, representing, and evaluating oriented detectors. We explore Gaussian distributions-called Gaussian Bounding Boxes (GBBs)-as fuzzy representations for oriented objects and propose using a similarity metric between two GBBs based on the Hellinger distance. We show that this metric leads to a differentiable closed-form expression that can be directly used as a localization loss term to train OBB object detectors. We also show that GBBs present a natural representation as elliptical regions (called EBBs), which inherently mitigate ambiguity representation for circular objects. Finally, we empirically show that the proposed similarity metric computed between two GBBs strongly correlates with the IoU between the corresponding EBBs, motivating the name Probabilistic Intersection-over-Union (ProbIoU). Our experiments show that results using ProbIoU as a regression loss are competitive with state-of-the-art alternatives without requiring additional hyperparameters or customized implementations, and that ProbIoU is a promising alternative to evaluate oriented object detectors. Our code is available at https://github.com/ProbIOU/.