Corpora compilation for prosody-informed speech processing

Research on speech technologies necessitates spoken data, which is usually obtained through read recorded speech, and specifically adapted to the research needs. When the aim is to deal with the prosody involved in speech, the available data must reflect natural and conversational speech, which is u...

Descripción completa

Detalles Bibliográficos
Autores: Oktem, Alp, Farrús, M., Bonafonte Cávez, Antonio|||0000-0002-6240-9915
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/454245
Acceso en línea:https://hdl.handle.net/2117/454245
https://dx.doi.org/10.1007/s10579-021-09556-2
Access Level:acceso abierto
Palabra clave:Speech technologies
Spoken data
Prosody
Conversational speech
Speech corpora
Machine learning
Deep learning
Punctuation restoration
Machine translation
Parallel corpora.
Descripción
Sumario:Research on speech technologies necessitates spoken data, which is usually obtained through read recorded speech, and specifically adapted to the research needs. When the aim is to deal with the prosody involved in speech, the available data must reflect natural and conversational speech, which is usually costly and difficult to get. This paper presents a machine learning-oriented toolkit for collecting, handling, and visualization of speech data, using prosodic heuristic. We present two corpora resulting from these methodologies: PANTED corpus, containing 250 h of English speech from TED Talks, and Heroes corpus containing 8 h of parallel English and Spanish movie speech. We demonstrate their use in two deep learning-based applications: punctuation restoration and machine translation. The presented corpora are freely available to the research community.