An Intelligent System for Outfall Detection in UAV Images Using Lightweight Convolutional Vision Transformer Network

Unmanned aerial vehicle aerial photography technology has become a crucial tool for detecting outfalls that discharge into rivers and oceans. However, the current retrieval process in aerial images relies heavily on visual interpretation by skilled experts, which is time-consuming and inefficient. T...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of selected topics in applied earth observations and remote sensing 2024, Vol.17, p.6265-6277
Main Authors: Yu, Mingxin, Zhang, Ji, Zhu, Lianqing, Liang, Shengjun, Lu, Wenshuai, Ji, Xinglong
Format: Article
Language:English
Subjects:
Aerial images
Aerial photography
Aggregation
Autonomous aerial vehicles
Biological system modeling
Computational modeling
Deep learning
Feature extraction
Feature maps
Image processing
Lightweight
Oceans
outfall detection
Outfalls
Rivers
Transformers
Unmanned aerial vehicles
Vision
vision transformer
Weight reduction
YOLO
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Unmanned aerial vehicle aerial photography technology has become a crucial tool for detecting outfalls that discharge into rivers and oceans. However, the current retrieval process in aerial images relies heavily on visual interpretation by skilled experts, which is time-consuming and inefficient. To address this issue, we propose a lightweight deep-learning model for detecting outfall objects in aerial images. Specifically, the backbone of our proposed model is a lightweight convolutional vision transformer network, which consists of two novel blocks: separated downsampled self-attention and convolutional feedforward network with a shortcut. These blocks are designed to capture information at different granularities in the feature map and build both local and global representations. The model utilizes a path aggregation feature pyramid network as the neck and a lightweight decoupled network as the head. The experiments demonstrate that our model achieves the highest accuracy of 81.5% while utilizing only 2.47 M parameters and 3.95 GFLOPs. Visualization analysis shows that our model pays more attention to true outfall objects. Additionally, we have developed an intelligent outfall detection system based on the proposed model, and the experimental results show that it performs well in the task of outfall detection.
ISSN:1939-1404
2151-1535
DOI:10.1109/JSTARS.2024.3400762