Intelligent Object Grasping With Sensor Fusion for Rehabilitation and Assistive Applications

• Published in: IEEE transactions on neural systems and rehabilitation engineering 2018-08, Vol.26 (8), p.1556-1565
• Main Authors: Lee, Brielle J. B., Williams, Adam, Ben-Tzvi, Pinhas
• Format: Article
• Language: English
• Subjects: Control systems design; Controllers; Design; Elastomers; Exoskeleton; Exoskeletons; Exploration; Feedback; Force; Grasping; Grasping (robotics); Rehabilitation; rehabilitation robotics; Robot sensing systems; Sensory feedback; Slip; slip detection; Slippage; State machines; Thumb; upper limb
• ISSN: 1534-4320; 1558-0210
• DOI: 10.1109/TNSRE.2018.2848549

This paper presents the design and control of the intelligent sensing and force-feedback exoskeleton robotic glove to create a system capable of intelligent object grasping initiated by detection of the user's intentions through motion amplification. Using a combination of sensory feedback streams from the glove, the system has the ability to identify and prevent object slippage, as well as adapting grip geometry to the object properties. The slip detection algorithm provides updated inputs to the force controller to prevent an object from being dropped, while only requiring minimal input from a user who may have varying degrees of functionality in their injured hand. This paper proposes the use of a high dynamic range, low cost conductive elastomer sensor coupled with a negative force derivative trigger that can be leveraged in order to create a controller that can intelligently respond to slip conditions through state machine architecture, and improve the grasping robustness of the exoskeleton. The improvements to the previous design are described while the details of the controller design and the proposed assistive and rehabilitative applications are explained. Experimental results confirming the validity of the proposed system are presented. Finally, this paper concludes with topics for future exploration.