Noise-Robust Automatic Speech Recognition: A Case Study for Communication Interference

An Automatic Speech Recognition (ASR) System is a software tool that converts a speech audio waveform into its corresponding text transcription. ASR systems are usually built using Artificial Intelligence techniques, particularly Machine Learning algorithms like Deep Learning, to address the multi-f...

Descripción completa

Detalles Bibliográficos
Autores: Duarte, Julio Cesar, Colcher, Sérgio
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:Brasil
Institución:Sociedade Brasileira de Computação (SBC)
Repositorio:Journal on Interactive Systems
Idioma:inglés
OAI Identifier:oai:journals-sol.sbc.org.br:article/4267
Acceso en línea:https://journals-sol.sbc.org.br/index.php/jis/article/view/4267
Access Level:acceso abierto
Palabra clave:Automatic Speech Recognition Systems
Noise Robustness
Portuguese ASRs
Descripción
Sumario:An Automatic Speech Recognition (ASR) System is a software tool that converts a speech audio waveform into its corresponding text transcription. ASR systems are usually built using Artificial Intelligence techniques, particularly Machine Learning algorithms like Deep Learning, to address the multi-faceted complexity and variability of human speech. This allows these systems to learn from extensive speech datasets, adapt to several languages and accents, and continuously improve their performance over time, making them each time more versatile and effective in their purpose of transcribing spoken language to text. Much in the same way, we argue that the noises commonly present in the different environments also need to be explicitly dealt with, and, when possible, modeled within specific datasets with proper training. Our motivation comes from the observation that noise removal techniques (commonly called denoising), are not always fully (and generically) efficient. For instance, noise degeneration due to communication interference, which is almost always present in radio transmissions, has peculiarities that a simple mathematical formulation cannot model. This work presents a modeling technique composed of an augmented dataset-building approach and a profile identifier that can be used to build ASRs for noisy environments that perform similarly to those used in noise-free environments. As a case study, we developed a specific ASR for the interference noise in radio transmissions with its specific dataset, while comparing our results with other state-of-the-art work. As a result, we report a Character Error Rate value of 0.3163 for the developed ASR under several different noise conditions.