Collision Avoidance for Multiple UAVs in Unknown Scenarios with Causal Representation Disentanglement

Deep reinforcement learning (DRL) has achieved remarkable progress in online path planning tasks for multi-UAV systems. However, existing DRL-based methods often suffer from performance degradation when tackling unseen scenarios, since the non-causal factors in visual representations adversely affec...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-07
Main Authors: Zhuang, Jiafan, Xia, Zihao, Han, Gaofei, Wang, Boxi, Li, Wenji, Wang, Dongliang, Hao, Zhifeng, Cai, Ruichu, Fan, Zhun
Format: Article
Language:English
Subjects:
Algorithms
Collision avoidance
Deep learning
Performance degradation
Representations
Unmanned aerial vehicles
Visual aspects
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep reinforcement learning (DRL) has achieved remarkable progress in online path planning tasks for multi-UAV systems. However, existing DRL-based methods often suffer from performance degradation when tackling unseen scenarios, since the non-causal factors in visual representations adversely affect policy learning. To address this issue, we propose a novel representation learning approach, \ie, causal representation disentanglement, which can identify the causal and non-causal factors in representations. After that, we only pass causal factors for subsequent policy learning and thus explicitly eliminate the influence of non-causal factors, which effectively improves the generalization ability of DRL models. Experimental results show that our proposed method can achieve robust navigation performance and effective collision avoidance especially in unseen scenarios, which significantly outperforms existing SOTA algorithms.
ISSN:2331-8422