Continuum-Body-Pose Estimation From Partial Sensor Information Using Recurrent Neural Networks

• Published in: IEEE robotics and automation letters 2022-10, Vol.7 (4), p.11244-11251
• Main Authors: Tanaka, Kazutoshi, Minami, Yuna, Tokudome, Yuji, Inoue, Katsuma, Kuniyoshi, Yasuo, Nakajima, Kohei
• Format: Article
• Language: English
• Subjects: AI-based methods; Bending; control; Deep sea environments; Estimation; learning for soft robots; Manipulators; modeling; Neural networks; Pose estimation; Program processors; Recurrent neural networks; Reservoirs; Robot arms; Robot sensing systems; Sensors; Soft robotics
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2022.3199034

Soft continuum arms have significant potential for use in various applications due to their extremely high degrees of freedom. For example, these soft arms can be used for grasping and manipulating fragile materials in the deep sea or carrying a human to rescue in unstructured environments. However, in these situations, the environment is often dark and visual cues are not always usable. Therefore, these arms must estimate their pose from proprioceptive sensors to control their behavior and execute their tasks in dark places. Estimating the pose in a dynamic situation is still challenging because of the arms' high dimensionality and the complex structural changes in the body shape. Therefore, this study demonstrates a novel method for estimating the pose of proprioceptive bending sensors using recurrent neural networks (RNNs). In particular, an RNN framework known as deep reservoir computing was used for this purpose. Results from experiments using an octopus-inspired soft robotic arm clearly indicate that the proposed method significantly outperforms existing methods using long short-term memory models or linear models. We expect that our proposed method will enable behavioral control of these arms in dark places such as the deep sea, space, and inside the human body in future applications.