Evaluation of Hand-Tracking Systems in Teleoperation and Virtual Dexterous Manipulation

• Published in: IEEE sensors journal 2020-02, Vol.20 (3), p.1642-1655
• Main Authors: Mizera, C., Delrieu, T., Weistroffer, V., Andriot, C., Decatoire, A., Gazeau, J.-P.
• Format: Article
• Language: English
• Subjects: Acoustics; Automatic; Biomechanics; Chemical Sciences; Configurations; data glove; dexterous manipulation; Electric power; Electromagnetism; End effectors; Engineering Sciences; Evaluation; Fluid mechanics; Gloves; grasp quality; Grippers; Human motion; Human performance; inside-hand manipulation; Instruments; Manipulation; Material chemistry; Materials and structures in mechanics; Mathematical Physics; Mechanics; Motion capture; Motion measurement; Performance evaluation; Physics; Polymers; Quantum Physics; Reactive fluid environment; Robot sensing systems; robotic hand; Robotics; Systems analysis; teleoperation; Thermics; Tracking devices; Tracking systems; Vibrations; Virtual environments; Virtual reality; Vision systems
• ISSN: 1530-437X; 1558-1748
• DOI: 10.1109/JSEN.2019.2947612

The quality of robotic dexterous manipulation, in real or in virtual environments, relies on a fine control of the fingertips to perform stable grasps and inside-hand manipulation. In practice, teleoperating a robotic hand requires to capture the human hand configuration.If the user manipulates objects with fingertips, the acquisition of their motion must be accurate enough to produce realistic manipulation at the robot hand or its virtual avatar. In this context, one challenge is to accurately capture the motion of the human hand. The performances of three different hand-tracking devices are evaluated in this paper: two data gloves, the VRFree and the Manus VR, and a vision-based system, the Leap Motion Controller. To this end, the positions of the human hand joints and fingertips are captured while performing several tasks, with a high-precision motion capture system as reference, and with the tested devices. The accuracy of the measured joint angles and fingertips positions is compared for the different systems. Specific measurement configurations are considered by varying the hand orientation and the distances to the sensors. The strengths and weaknesses of these different systems are deduced from the experiments. This system review gives insights into the relevance of hand-tracking devices for remote robotic or virtual manipulation.