Research Challenges, Recent Advances, and Popular Datasets in Deep Learning-Based Underwater Marine Object Detection: A Review

• Published in: Sensors (Basel, Switzerland) Switzerland), 2023-02, Vol.23 (4), p.1990
• Main Authors: Er, Meng Joo, Chen, Jie, Zhang, Yani, Gao, Wenxiao
• Format: Article
• Language: English
• Subjects: Cameras; Comparative studies; Datasets; Deep learning; Fisheries; Image degradation; Image quality; image quality degradation; Marine engineering; Marine sciences; Natural resources; Oceans; poor generalization; popular datasets; R&D; Research & development; Review; Robots; Semantics; small object detection; Strategic management; underwater marine object detection; vision
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23041990

Underwater marine object detection, as one of the most fundamental techniques in the community of marine science and engineering, has been shown to exhibit tremendous potential for exploring the oceans in recent years. It has been widely applied in practical applications, such as monitoring of underwater ecosystems, exploration of natural resources, management of commercial fisheries, etc. However, due to complexity of the underwater environment, characteristics of marine objects, and limitations imposed by exploration equipment, detection performance in terms of speed, accuracy, and robustness can be dramatically degraded when conventional approaches are used. Deep learning has been found to have significant impact on a variety of applications, including marine engineering. In this context, we offer a review of deep learning-based underwater marine object detection techniques. Underwater object detection can be performed by different sensors, such as acoustic sonar or optical cameras. In this paper, we focus on vision-based object detection due to several significant advantages. To facilitate a thorough understanding of this subject, we organize research challenges of vision-based underwater object detection into four categories: image quality degradation, small object detection, poor generalization, and real-time detection. We review recent advances in underwater marine object detection and highlight advantages and disadvantages of existing solutions for each challenge. In addition, we provide a detailed critical examination of the most extensively used datasets. In addition, we present comparative studies with previous reviews, notably those approaches that leverage artificial intelligence, as well as future trends related to this hot topic.