Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey

• Published in: IEEE reviews in biomedical engineering 2022, Vol.15, p.85-102
• Main Authors: Jiang, Shuo, Kang, Peiqi, Song, Xinyu, Lo, Benny, Shull, Peter
• Format: Article
• Language: English
• Subjects: Algorithms; Deep learning; Discriminant analysis; electromyography; Exoskeleton; Exoskeletons; forcemyography; Gesture recognition; Gestures; Hand; Hand (anatomy); human-computer interaction; Human-computer interface; Humans; Interfaces; Learning algorithms; Machine learning; Machine learning algorithms; Mathematical analysis; Neurological diseases; Prostheses; Prosthetics; Quality of Life; Recovery of function; Rehabilitation; Reproducibility of Results; Stroke (medical condition); Support vector machines; Training; Wearable Electronic Devices; Wearable technology; Wrist
• ISSN: 1937-3333; 1941-1189
• DOI: 10.1109/RBME.2021.3078190

Hands are vital in a wide range of fundamental daily activities, and neurological diseases that impede hand function can significantly affect quality of life. Wearable hand gesture interfaces hold promise to restore and assist hand function and to enhance human-human and human-computer communication. The purpose of this review is to synthesize current novel sensing interfaces and algorithms for hand gesture recognition, and the scope of applications covers rehabilitation, prosthesis control, exoskeletons for augmentation, sign language recognition, human-computer interaction, and user authentication. Results showed that electrical, mechanical, acoustical/vibratory, and optical sensing were the primary input modalities in gesture recognition interfaces. Two categories of algorithms were identified: 1) classification algorithms for predefined, fixed hand poses and 2) regression algorithms for continuous finger and wrist joint angles. Conventional machine learning algorithms, including linear discriminant analysis, support vector machines, random forests, and non-negative matrix factorization, have been widely used for a variety of gesture recognition applications, and deep learning algorithms have more recently been applied to further facilitate the complex relationship between sensor signals and multi-articulated hand postures. Future research should focus on increasing recognition accuracy with larger hand gesture datasets, improving reliability and robustness for daily use outside of the laboratory, and developing softer, less obtrusive interfaces.