Active robotic search for victims using ensemble deep learning techniques

• Published in: Machine learning: science and technology 2024-06, Vol.5 (2), p.25004
• Main Authors: García-Samartín, Jorge F, Cruz Ulloa, Christyan, del Cerro, Jaime, Barrientos, Antonio
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial neural networks; computer vision; Decision trees; ensamble deep learning; legged robots; Machine learning; random forests; Rescue operations; Robots; Search and rescue missions; search and rescue robots; sensing and perception; Unknown environments
• ISSN: 2632-2153; 2632-2153
• DOI: 10.1088/2632-2153/ad33df

In recent years, legged quadruped robots have proved to be a valuable support to humans in dealing with search and rescue operations. These robots can move with great ability in complex terrains, unstructured environments or regions with many obstacles. This work employs the quadruped robot A1 Rescue Tasks UPM Robot (ARTU-R) by Unitree, equipped with an RGB-D camera and a lidar, to perform victim searches in post-disaster scenarios. Exploration is done not by following a pre-planned path (as common methods) but by prioritising the areas most likely to harbour victims. To accomplish that task, both indirect search and next best view techniques have been used. When ARTU-R gets inside an unstructured and unknown environment, it selects the next exploration point from a series of candidates. This operation is performed by comparing, for each candidate, the distance to reach it, the unexplored space around it and the probability of a victim being in its vicinity. This probability value is obtained using a Random Forest, which processes the information provided by a convolutional neural network. Unlike other AI techniques, random forests are not black box models; humans can understand their decision-making processes. The system, once integrated, achieves speeds comparable to other state-of-the-art algorithms in terms of exploration, but concerning victim detection, the tests show that the resulting smart exploration generates logical paths—from a human point of view—and that ARTU-R tends to move first to the regions where victims are present.