Drone System Remotely Controlled by Human Eyes: A Consideration of its Effectiveness When Remotely Controlling a Robot

• Published in: Journal of robotics and mechatronics 2024-10, Vol.36 (5), p.1055-1064
• Main Authors: Kai, Yoshihiro, Seki, Yuki, Wu, Yuze, Blaquera, Allan Paulo, Tanioka, Tetsuya
• Format: Article
• Language: English
• Subjects: Construction equipment; Construction sites; Control equipment; Control systems; Effectiveness; Fatigue; Natural disasters; Remote control; Robot control; Robots; Visual tasks
• ISSN: 0915-3942; 1883-8049
• DOI: 10.20965/jrm.2024.p1055

In recent years, Japan has experienced numerous natural disasters, such as typhoons and earthquakes. Teleoperated ground robots (including construction equipment) are effective tools for restoration work at disaster sites and other locations that are dangerous and inaccessible to humans. Using visual information obtained from various viewpoints by a drone can allow for more effective remote control of a teleoperated ground robot, making it easier for the robot to perform a task. We previously proposed and developed a remote-controlled drone system using only human eyes. However, the effectiveness of using this drone system during the remote control of a robot has never been verified. In this paper, as the first step in verifying the effectiveness of the remote-controlled drone system using only the eyes when remote-controlling a robot, we consider its effectiveness in a simple task based on the task times, subjects’ eye fatigue, and subjective evaluations of subjects. First, the previously proposed drone system is briefly described. Next, we describe an experiment in which a drone was controlled by the eyes using the drone system while a robot was controlled by hand, and an experiment in which both the drone and robot were controlled by hand without using the drone system. Based on the experimental results, we evaluate the effectiveness of the remote-controlled drone system using only the eyes when remote-controlling a robot.