A Stereo-Panoramic Telepresence System for Construction Machines

Working machines in construction sites or emergency scenarios can operate in situations that can be dangerous for the operator. On the contrary, remote operation has been typically hindered by limited sense of presence of the operator in the environment due to the reduced field of view of cameras. S...

Full description

Saved in:
Bibliographic Details
Published in:Procedia manufacturing 2017, Vol.11, p.1552-1559
Main Authors: Tripicchio, Paolo, Ruffaldi, Emanuele, Gasparello, Paolo, Eguchi, Shingo, Kusuno, Junya, Kitano, Keita, Yamada, Masaki, Argiolas, Alfredo, Niccolini, Marta, Ragaglia, Matteo, Avizzano, Carlo Alberto
Format: Article
Language:English
Subjects:
Construction Machine
Immersive Telepresence
Stereo-Panoramic
teleoperation
vision head
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Working machines in construction sites or emergency scenarios can operate in situations that can be dangerous for the operator. On the contrary, remote operation has been typically hindered by limited sense of presence of the operator in the environment due to the reduced field of view of cameras. Starting from these considerations, this work introduces a novel real-time panoramic telepresence system for construction machines. This system does allow fully immersive operations in critical scenarios while keeping the operator in a safe location at safe distance from the construction operation. An omnidirectional stereo vision head mounted over the machine acquires and sends data to the operator with a streaming technique that focuses on the current direction of sight of the operator. The operator uses a head-mounted display to experience the remote site also with the possibility to view digital information overlaid to the remote scene as a type of augmented reality. The paper addresses the design and architecture of the system starting from the vision system and then proceeding to the immersive visualization.
ISSN:2351-9789
2351-9789
DOI:10.1016/j.promfg.2017.07.292