Spectro-Temporal Energy Ratio Features for Single-Corpus and Cross-Corpus Experiments in Speech Emotion Recognition

• Published in: Arabian journal for science and engineering (2011) 2024-03, Vol.49 (3), p.3209-3223
• Main Authors: Parlak, Cevahir, Diri, Banu, Altun, Yusuf
• Format: Article
• Language: English
• Subjects: Algorithms; Emotion recognition; Emotions; Engineering; Filter banks; Humanities and Social Sciences; multidisciplinary; Research Article-Computer Engineering and Computer Science; Science; Speech recognition
• ISSN: 2193-567X; 1319-8025; 2191-4281
• DOI: 10.1007/s13369-023-07920-8

In this study, novel Spectro-Temporal Energy Ratio features based on the formants of vowels, linearly spaced low-frequency, and logarithmically spaced high-frequency parts of the human auditory system are introduced to implement single- and cross-corpus speech emotion recognition experiments. Since the underlying dynamics and characteristics of speech recognition and speech emotion recognition differ too much, designing an emotion-recognition-specific filter bank is mandatory. The proposed features will formulate a novel filter bank strategy to construct 7 trapezoidal filter banks. These novel filter banks differ from Mel and Bark scales in shape and frequency regions and are targeted to generalize the feature space. Cross-corpus experimentation is a step forward in speech emotion recognition, but the researchers are usually chagrined at its results. Our goal is to create a feature set that is robust and resistant to cross-corporal variations using various feature selection algorithms. We will prove this by shrinking the dimension of the feature space from 6984 down to 128 while boosting the accuracy using SVM, RBM, and sVGG (small-VGG) classifiers. Although RBMs are considered no longer fashionable, we will show that they can achieve outstanding jobs when tuned properly. This paper discloses a striking 90.65% accuracy rate harnessing STER features on EmoDB.