Table-Balancing Cooperative Robot Based on Deep Reinforcement Learning

• Published in: Sensors (Basel, Switzerland) Switzerland), 2023-05, Vol.23 (11), p.5235
• Main Authors: Kim, Yewon, Kim, Dae-Won, Kang, Bo-Yeong
• Format: Article
• Language: English
• Subjects: Animal behavior; Artificial intelligence; Balancing; Cameras; Cooperation; cooperative robot; Deep learning; deep Q-network; Human acts; Human behavior; human–robot interaction; Injury prevention; Neural networks; reinforcement learning; Robotics industry; Robots; Verbal communication
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23115235

Reinforcement learning is one of the artificial intelligence methods that enable robots to judge and operate situations on their own by learning to perform tasks. Previous reinforcement learning research has mainly focused on tasks performed by individual robots; however, everyday tasks, such as balancing tables, often require cooperation between two individuals to avoid injury when moving. In this research, we propose a deep reinforcement learning-based technique for robots to perform a table-balancing task in cooperation with a human. The cooperative robot proposed in this paper recognizes human behavior to balance the table. This recognition is achieved by utilizing the robot's camera to take an image of the state of the table, then the table-balance action is performed afterward. Deep Q-network (DQN) is a deep reinforcement learning technology applied to cooperative robots. As a result of learning table balancing, on average, the cooperative robot showed a 90% optimal policy convergence rate in 20 runs of training with optimal hyperparameters applied to DQN-based techniques. In the H/W experiment, the trained DQN-based robot achieved an operation precision of 90%, thus verifying its excellent performance.