Teleoperation by seamless transitions in real and virtual world environments

• Published in: Robotics and autonomous systems 2023-06, Vol.164, p.104405, Article 104405
• Main Authors: Aoki, Junki, Sasaki, Fumihiro, Yamashina, Ryota, Kurazume, Ryo
• Format: Article
• Language: English
• Subjects: Human–robot interaction; Shared autonomy; Teleoperation; Virtual reality
• ISSN: 0921-8890; 1872-793X
• DOI: 10.1016/j.robot.2023.104405

This study investigates operability and acceptability issues in the teleoperation of robots. Prior studies have proposed efficient approaches to increase human perceptual ability and robot autonomy but with reduced operability and acceptance. We propose a novel teleoperation method that overcomes the weaknesses of existing approaches while inheriting their strengths. The key feature of our method is switching the teleoperated robot world from real to virtual. The user study results showed that the proposed method offered an improved user experience compared to the conventional methods, while task efficiency was equivalent in all methods. The contributions of this paper include the proposal of the teleoperation method by seamless switching between real and virtual space, the proposal of an image transformation method and visual effect to achieve seamless switching, and verification of the practicality of the proposed system through experiments on actual mobile robots. •Illusory control improved the operability and acceptability of the robot system.•An image transformation using neural networks for seamless transitions.•A visual effect that amplifies the sense of speed for seamless transitions.