Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perfor...

Full description

Saved in:
Bibliographic Details
Published in:Multimodal technologies and interaction 2020-12, Vol.4 (4), p.78
Main Authors: Pinto, Andoni Rivera, Kildal, Johan, Lazkano, Elena
Format: Article
Language:English
Subjects:
augmented reality
cobot
hologram
human–robot interaction
mid-air haptics
multimodal
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.
ISSN:2414-4088
2414-4088
DOI:10.3390/mti4040078