Emotion stimuli-based surface electromyography signal classification employing Markov transition field and deep neural networks

• Published in: Measurement : journal of the International Measurement Confederation 2022-02, Vol.189, p.110470, Article 110470
• Main Authors: Li, Rongjie, Wu, Yao, Wu, Qun, Dey, Nilanjan, González Crespo, Rubén, Shi, Fuqian
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Bionics; Clinical medicine; Deep neural network; Electromyography; Emotion recognition; Emotions; Human-computer interaction; Industrial development; Markov analysis; Markov transition field; Neural networks; Prostheses; Rehabilitation; Signal classification; Signal image transition; Signal processing; Stimuli; Surface electromyography
• ISSN: 0263-2241; 1873-412X
• DOI: 10.1016/j.measurement.2021.110470

[Display omitted] •Using new sensor based signal sEMG for affective computing.•Combinging Markov transition field and deep neural networks.•Developed a emotion stimuli-based experimets to classify emotion.•Comparing with several deep neural networks using defined indices regarding the proposed model. Surface electromyography (sEMG) has been widely used in clinical medicine, rehabilitation medicine, and intelligent robots. Currently, sEMG signal classification methods promoted the development and industrialization of sEMG control bionic prostheses. Emotion recognition using sEMG signal is crucial in human–computer interaction (HCI) and becoming a research hotspot. While the high rate of emotion recognition is still the key issue for the emotion applications. Employing sEMG to study emotion classification can improve the recognition rate and eliminate subjective interference. In this research, the Markov transition field (MTF) method was applied to convert sEMG signals to images; and this crucial converting process makes convolutional neural networks adopting the input resource. A 69-INPUT-6 -OUTPUT primary deep neural network was constructed for classifying the human emotion states under emotion stimuli experiment. The MTF-based deep neural network (MTF-DNN) for classifying sEMG signals was developed and validated subsequently. The result showed that the high effectiveness of the proposed classification model. The proposed MTFDNN performs high efficacy in the indices of classification of Ac (0.9102), Pr (0.1867), and Fm (0.9089) by comparing with different classification models.