EmoMatchSpanishDB: study of speech emotion recognition machine learning models in a new Spanish elicited database

• Published in: Multimedia tools and applications 2024-02, Vol.83 (5), p.13093-13112
• Main Authors: Garcia-Cuesta, Esteban, Salvador, Antonio Barba, Pãez, Diego Gachet
• Format: Article
• Language: English
• Subjects: Audio data; Comparative studies; Computer Communication Networks; Computer Science; Crowdsourcing; Data Structures and Information Theory; Datasets; Emotion recognition; Emotions; Machine learning; Multimedia Information Systems; Special Purpose and Application-Based Systems; Speech recognition; State-of-the-art reviews
• ISSN: 1573-7721; 1380-7501; 1573-7721
• DOI: 10.1007/s11042-023-15959-w

In this paper we present a new speech emotion dataset on Spanish. The database is created using an elicited approach and is composed by fifty non-actors expressing the Ekman’s six basic emotions of anger, disgust, fear, happiness, sadness, and surprise, plus neutral tone. This article describes how this database has been created from the recording step to the performed crowdsourcing perception test step. The crowdsourcing has facilitated to statistically validate the emotion of each collected audio sample and also to filter noisy data samples. Hence we obtained two datasets EmoSpanishDB and EmoMatchSpanishDB. The first includes those recorded audios that had consensus during the crowdsourcing process. The second selects from EmoSpanishDB only those audios whose emotion also matches with the originally elicited. Last, we present a baseline comparative study between different state of the art machine learning techniques in terms of accuracy, precision, and recall for both datasets. The results obtained for EmoMatchSpanishDB improves the ones obtained for EmoSpanishDB and thereof, we recommend to follow the methodology that was used for the creation of emotional databases.