Robust multi-scenario speech-based emotion recognition system

Every human being experiences emotions daily, e.g., joy, sadness, fear, anger. These might be revealed through speech--words are often accompanied by our emotional states when we talk. Different acoustic emotional databases are freely available for solving the Emotional Speech Recognition (ESR) task...

Descripción completa

Detalles Bibliográficos
Autores: Zhu Zhou, Fang Fang|||0000-0003-2797-6073, Gil Pita, Roberto|||0000-0002-1790-3834, García Gómez, Joaquín, Rosa Zurera, Manuel|||0000-0002-3073-3278
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universidad de Alcalá (UAH)
Repositorio:e_Buah Biblioteca Digital Universidad de Alcalá
Idioma:inglés
OAI Identifier:oai:ebuah.uah.es:10017/67663
Acceso en línea:http://hdl.handle.net/10017/67663
https://dx.doi.org/10.3390/s22062343
Access Level:acceso abierto
Palabra clave:Affective computing
Emotion recognition
Speech emotions
Electrónica
Electronics
Descripción
Sumario:Every human being experiences emotions daily, e.g., joy, sadness, fear, anger. These might be revealed through speech--words are often accompanied by our emotional states when we talk. Different acoustic emotional databases are freely available for solving the Emotional Speech Recognition (ESR) task. Unfortunately, many of them were generated under non-real-world conditions, i.e., actors played emotions, and recorded emotions were under fictitious circumstances where noise is non-existent. Another weakness in the design of emotion recognition systems is the scarcity of enough patterns in the available databases, causing generalization problems and leading to overfitting. This paper examines how different recording environmental elements impact system performance using a simple logistic regression algorithm. Specifically, we conducted experiments simulating different scenarios, using different levels of Gaussian white noise, real-world noise, and reverberation. The results from this research show a performance deterioration in all scenarios, increasing the error probability from 25.57% to 79.13% in the worst case. Additionally, a virtual enlargement method and a robust multi-scenario speech-based emotion recognition system are proposed. Our system?s average error probability of 34.57% is comparable to the best-case scenario with 31.55%. The findings support the prediction that simulated emotional speech databases do not offer sufficient closeness to real scenarios.