VALNet: Vision-Based Autonomous Landing with Airport Runway Instance Segmentation

• Published in: Remote sensing (Basel, Switzerland) Switzerland), 2024-06, Vol.16 (12), p.2161
• Main Authors: Wang, Qiang, Feng, Wenquan, Zhao, Hongbo, Liu, Binghao, Lyu, Shuchang
• Format: Article
• Language: English
• Subjects: Accuracy; Adaptability; Aircraft; Aircraft landing; Airports; Automation; Aviation; band-pass filtering; Bandpass filters; Cost effectiveness; Datasets; Deep learning; heatmap guided; Image processing; Image rotation; Image segmentation; Information processing; Instance segmentation; Landing aids; Modules; Navigation; Orientation behavior; R&D; Research & development; Runways; Unmanned aerial vehicles; Vision; vision-based autonomous landing
• ISSN: 2072-4292
• DOI: 10.3390/rs16122161

Visual navigation, characterized by its autonomous capabilities, cost effectiveness, and robust resistance to interference, serves as the foundation for vision-based autonomous landing systems. These systems rely heavily on runway instance segmentation, which accurately divides runway areas and provides precise information for unmanned aerial vehicle (UAV) navigation. However, current research primarily focuses on runway detection but lacks relevant runway instance segmentation datasets. To address this research gap, we created the Runway Landing Dataset (RLD), a benchmark dataset that focuses on runway instance segmentation mainly based on X-Plane. To overcome the challenges of large-scale changes and input image angle differences in runway instance segmentation tasks, we propose a vision-based autonomous landing segmentation network (VALNet) that uses band-pass filters, where a Context Enhancement Module (CEM) guides the model to learn adaptive “band” information through heatmaps, while an Orientation Adaptation Module (OAM) of a triple-channel architecture to fully utilize rotation information enhances the model’s ability to capture input image rotation transformations. Extensive experiments on RLD demonstrate that the new method has significantly improved performance. The visualization results further confirm the effectiveness and interpretability of VALNet in the face of large-scale changes and angle differences. This research not only advances the development of runway instance segmentation but also highlights the potential application value of VALNet in vision-based autonomous landing systems. Additionally, RLD is publicly available.