Optimizing the Area Coverage of Networked UAVs using Multi-Agent Reinforcement Learning

Wireless sensor networks (WSNs) have been widely used in various area coverage applications which require the monitoring and surveillance of systems with spatiotemporally varying variables or parameters. One important task in the implementation of WSNs for area coverage and monitoring purposes is th...

Full description

Saved in:
Bibliographic Details
Main Author: Tamba, Tua A.
Format: Conference Proceeding
Language:English
Subjects:
area coverage problem
Computational modeling
Games
Markov processes
multi-agent reinforcement learning
networked UAVs
Reinforcement learning
Simulation
Surveillance
Wireless sensor networks
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Wireless sensor networks (WSNs) have been widely used in various area coverage applications which require the monitoring and surveillance of systems with spatiotemporally varying variables or parameters. One important task in the implementation of WSNs for area coverage and monitoring purposes is the determination of the solution for the optimal coverage problem. This paper describes that the formulation of the area coverage problem can be modeled using Markov game modeling formalism whereas the optimal joint state-action policy for each agent which also takes into consideration the group objective can be computed using multi-agent Q-learning iterative processes using multi-agent reinforcement learning framework. Simulation results are presented to illustrate the proposed iterative learning-based area coverage solution approach.
ISSN:2639-5045
DOI:10.1109/ICA52848.2021.9625676