GDM-Net: Gas Distribution Mapping with a Mobile Robot Using Deep Reinforcement Learning and Gaussian Process Regression

• Main Authors: Kulbaka, Iliya, Dutta, Ayan, Kreidl, O. Patrick, Boloni, Ladislau, Roy, Swapnoneel
• Format: Conference Proceeding
• Language: English
• Subjects: Battery charge measurement; Chemicals; Deep reinforcement learning; Gaussian processes; Intelligent robots; Meters; Mobile robots; Robot sensing systems; Sensors; Uncertainty
• ISSN: 2153-0866
• DOI: 10.1109/IROS58592.2024.10802502

In a gas distribution mapping (GDM) task, the objective of a mobile robot is to map the gas concentrations of an airborne chemical over a region of interest using onboard sensing. Given the limited battery budget available to the robot, covering the entire area to measure gas concentrations at every location might be infeasible. Assuming that the robot only has a budget for b meters of travel, in the rest of the locations, gas concentrations can be inferred using a supervised machine learning technique, namely the Gaussian Process (GP). In this paper, we propose a novel technique that combines deep reinforcement learning and GP regression to find an effective policy for GDM. We have implemented the proposed technique in Python within a 16×16 4-connected plane. We have used six types of Gaussian plumes to validate our presented approach. Compared to two popular baselines, our approach outperforms greedy and random exploration by 62% and 151% in terms of earned rewards, while outperforming them by 47% and 345%, respectively, in terms of the precision of gas distribution modeling in all test cases without obstacles. Our approach also improves the coverage of the exploration while consequently reducing the uncertainty in the prediction.