Inherent dimension of the affective space: Analysis using electromyography and machine learning

• Published in: Cognitive systems research 2023-03, Vol.78, p.96-105
• Main Authors: Gadzhiev, Ismail M., Knyshenko, Mikhail P., Dolenko, Sergei A., Samsonovich, Alexei V.
• Format: Article
• Language: English
• Subjects: Affective space; Dimensionality reduction; Electromyography; Facial expressions; Inherent dimension; Machine learning
• ISSN: 1389-0417; 1389-0417
• DOI: 10.1016/j.cogsys.2022.12.008

Among dimensional models of emotions, two- and three-dimensional are most popular, while the true dimension of affective space is a matter of debates. Here we study the inherent dimension of the emotion space represented in facial expressions, along with the mapping of electromyography (EMG) signals recorded from facial muscles to expressed emotions. For this purpose, an experiment was conducted with parallel EMG recording from three facial muscles (Zygomaticus Major, Corrugator Supercilii, and Masseter) and video registration of the face with automated emotion recognition from the video stream. Data analysis based on machine learning methods confirmed the 3D nature of the affective space (at least its part reflected in facial expressions). This result is consistent with the VAD and PAD models. Possibilities of accounting for complex, higher-order, or social emotions without introducing additional dimensions are discussed. The second finding of this study is the ability to reconstruct all three significant principal components of expressed affects using EMG signals recorded from three facial muscles with the help of machine learning.