End-to-End Estimation of Hand- and Wrist Forces From Raw Intramuscular EMG Signals Using LSTM Networks

• Published in: Frontiers in neuroscience 2021-11, Vol.15, p.777329-777329
• Main Authors: Olsson, Alexander E., Malešević, Nebojša, Björkman, Anders, Antfolk, Christian
• Format: Article
• Language: English
• Subjects: Algorithms; Amputation; Deep learning; Electrodes; Electromyography; force; Forearm; iEMG; Interfaces; Kinematics; Long short-term memory; LSTM; Machine learning; Medical and Health Sciences; Medical Biotechnology; Medicin och hälsovetenskap; Medicinsk bioteknologi; Muscles; myoelectric control; Neural networks; Neurologi; Neurology; Neuroscience; Neurosciences & Neurology; Pattern recognition; proportional control; Prostheses; Prosthetics; Recording sessions; recurrent neural networks; regression; Regression analysis; Signal processing; simulation; simultaneous control; surface; Wrist
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2021.777329

Processing myoelectrical activity in the forearm has for long been considered a promising framework to allow transradial amputees to control motorized prostheses. In spite of expectations, contemporary muscle–computer interfaces built for this purpose typically fail to satisfy one or more important desiderata, such as accuracy, robustness, and/or naturalness of control, in part due to difficulties in acquiring high-quality signals continuously outside laboratory conditions. In light of such problems, surgically implanted electrodes have been made a viable option that allows for long-term acquisition of intramuscular electromyography (iEMG) measurements of spatially precise origin. As it stands, the question of how information embedded in such signals is best extracted and combined across multiple channels remains open. This study presents and evaluates an approach to this end that uses deep neural networks based on the Long Short-Term Memory (LSTMs) architecture to regress forces exerted by multiple degrees of freedom (DoFs) from multichannel iEMG. Three deep learning models, representing three distinct regression strategies, were evaluated: (I) One-to-One, wherein each DoF is separately estimated by an LSTM model processing a single iEMG channel, (II) All-to-One, wherein each DoF is separately estimated by an LSTM model processing all iEMG channels, and (III) All-to-All, wherein a single LSTM model with access to all iEMG channels estimates all DoFs simultaneously. All models operate on raw iEMG, with no preliminary feature extraction required. When evaluated on a dataset comprising six iEMG channels with concurrent force measurements acquired from 14 subjects, all LSTM strategies were found to significantly outperform a baseline feature-based linear control regression method. This finding indicates that recurrent neural networks can learn to transform raw forearm iEMG signals directly into representations that correlate with forces exerted at the level of the hand to a greater degree than simple features do. Furthermore, the All-to-All and All-to-One strategies were found to exhibit better performance than the One-to-One strategy. This finding suggests that, in spite of the spatially local nature of signals, iEMG from muscles not directly actuating the relevant DoF can provide contextual information that aid in decoding motor intent.