Real-time detection of uneaten feed pellets in underwater images for aquaculture using an improved YOLO-V4 network

• Published in: Computers and electronics in agriculture 2021-06, Vol.185, p.106135, Article 106135
• Main Authors: Hu, Xuelong, Liu, Yang, Zhao, Zhengxi, Liu, Jintao, Yang, Xinting, Sun, Chuanheng, Chen, Shuhan, Li, Bin, Zhou, Chao
• Format: Article
• Language: English
• Subjects: Accuracy; Aquaculture; Deep learning; Feature maps; Image quality; Improved YOLO-V4 network; Pellets; Real time; Redundancy; Underwater; Underwater object detection; Uneaten feed pellets; Water pollution
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2021.106135

•Uneaten feed pellets were detected in real time from underwater images.•The YOLO-V4 network is improved by modifying the feature map, DenseNet and de-redundancy.•The average precision is improved by 27.21%, and the amount of computation is reduced by approximately 30%.•More scientific feeding strategies can be formulated based on the detected uneaten feed pellets. In aquaculture, the real-time detection and monitoring of feed pellet consumption is an important basis for formulating scientific feeding strategies that can effectively reduce feed waste and water pollution, which is a win-win scenario in terms of economic and ecological benefits. However, low-quality underwater images and extremely small targets present great challenges to feed pellet detection. To overcome these challenges, this paper proposes an uneaten feed pellet detection model using an improved You Only Look Once (YOLO)-V4 network for aquaculture. The specific implementation methods are as follows: (1) The feature map responsible for large-scale information in the original YOLO-V4 network is replaced by a finer-grained YOLO feature map by modifying the connection mode of the feature pyramid network (FPN) + path aggregation network (PANet). (2) The residual connection mode in CSPDarknets is modified via a DenseNet, which further improves the feature reuse and the network performance. (3) Finally, a de-redundancy operation is carried out to reduce the complexity of the YOLO-V4 network while ensuring the detection accuracy. Experimental results in a real fish farm showed that the detection accuracy is better than that of the original YOLO-V4 network, and the average precision is improved from 65.40% to 92.61% (when the intersection over union is 0.5), for an increase of 27.21%. Additionally, the amount of computation is reduced by approximately 30%. Therefore, the improved YOLO-V4 network can effectively detect underwater feed pellets and is applicable in actual aquaculture environments.