A Deep Learning Approach for Biped Robot Locomotion Interface Using a Single Inertial Sensor

• Published in: Sensors (Basel, Switzerland) Switzerland), 2023-12, Vol.23 (24), p.9841
• Main Authors: Alemayoh, Tsige Tadesse, Lee, Jae Hoon, Okamoto, Shingo
• Format: Article
• Language: English
• Subjects: Analysis; Animation; Control algorithms; Correspondence; Data entry; Deep learning; Design; Gait; inertial sensor; Kinematics; Motion capture; motion synthesis; Neural networks; Robots; Sensors; Velocity; walking controller
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23249841

In this study, we introduce a novel framework that combines human motion parameterization from a single inertial sensor, motion synthesis from these parameters, and biped robot motion control using the synthesized motion. This framework applies advanced deep learning methods to data obtained from an IMU attached to a human subject's pelvis. This minimalistic sensor setup simplifies the data collection process, overcoming price and complexity challenges related to multi-sensor systems. We employed a Bi-LSTM encoder to estimate key human motion parameters: walking velocity and gait phase from the IMU sensor. This step is followed by a feedforward motion generator-decoder network that accurately produces lower limb joint angles and displacement corresponding to these parameters. Additionally, our method also introduces a Fourier series-based approach to generate these key motion parameters solely from user commands, specifically walking speed and gait period. Hence, the decoder can receive inputs either from the encoder or directly from the Fourier series parameter generator. The output of the decoder network is then utilized as a reference motion for the walking control of a biped robot, employing a constraint-consistent inverse dynamics control algorithm. This framework facilitates biped robot motion planning based on data from either a single inertial sensor or two user commands. The proposed method was validated through robot simulations in the MuJoco physics engine environment. The motion controller achieved an error of ≤5° in tracking the joint angles demonstrating the effectiveness of the proposed framework. This was accomplished using minimal sensor data or few user commands, marking a promising foundation for robotic control and human-robot interaction.