Reconstructing Human Hand Pose and Configuration using a Fixed-Base Exoskeleton

Accurate real-time estimation of the pose and configuration of the human hand attached to a dexterous haptic input device is crucial to improve the interaction possibilities for teleoperation and in virtual and augmented reality. In this paper, we present an approach to reconstruct the pose of the h...

Full description

Saved in:
Bibliographic Details
Main Authors: Pereira, A., Stillfried, G., Baker, T., Schmidt, A., Maier, A., Pleintinger, B., Chen, Z., Hulin, T., Lii, N. Y.
Format: Conference Proceeding
Language:English
Subjects:
Exoskeletons
Kinematics
Magnetic resonance imaging
Manipulators
Robot kinematics
Thumb
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Accurate real-time estimation of the pose and configuration of the human hand attached to a dexterous haptic input device is crucial to improve the interaction possibilities for teleoperation and in virtual and augmented reality. In this paper, we present an approach to reconstruct the pose of the human hand and the joint angles of the fingers when wearing a novel fixed-base (grounded) hand exoskeleton. Using a kinematic model of the human hand built from MRI data, we can reconstruct the hand pose and joint angles without sensors on the human hand, from attachment points on the first three fingers and the palm. We test the accuracy of our approach using motion capture as a ground truth. This reconstruction can be used to determine contact geometry and force-feedback from virtual or remote objects in virtual reality or teleoperation.
ISSN:2577-087X
DOI:10.1109/ICRA.2019.8794059