Data-driven pitch content description of choral singing recordings

Ensemble singing is a well-established practice across cultures, found in a great diversity of forms, languages, and levels. However, it has not been widely studied in the field of Music Information Retrieval (MIR), likely due to the lack of appropriate data. In this dissertation, we first address t...

Descripción completa

Detalles Bibliográficos
Autor: Cuesta, Helena
Tipo de recurso: tesis doctoral
Estado:Versión publicada
Fecha de publicación:2022
País:España
Institución:CBUC, CESCA
Repositorio:TDR. Tesis Doctorales en Red
OAI Identifier:oai:www.tdx.cat:10803/673924
Acceso en línea:http://hdl.handle.net/10803/673924
Access Level:acceso abierto
Palabra clave:Singing
Choral singing
Vocal music
Multi-pitch estimation
Voice assignment
Open data
Unison
MIR
Automatic music transcription
Cant
Cant coral
Música vocal
Estimació de múltiples freqüències
Assignació de veus
Dades obertes
Uníson
Transcripció automàtica de música
62
Descripción
Sumario:Ensemble singing is a well-established practice across cultures, found in a great diversity of forms, languages, and levels. However, it has not been widely studied in the field of Music Information Retrieval (MIR), likely due to the lack of appropriate data. In this dissertation, we first address the data scarcity by building new open, multi-track datasets of ensemble singing. Then, we address three main research problems: multiple F0 estimation and streaming, voice assignment, and the characterization of vocal unisons, all in the context of four-part vocal ensembles. Hence, the first contribution of this thesis is the development and release of four multi-track datasets of vocal ensembles: Choral Singing Dataset, Dagstuhl ChoirSet, ESMUC Choir Dataset, and Cantoría Dataset, all of them with audio recordings and accompanying annotations. The second contribution is a set of deep learning models for multiple F0 estimation, streaming, and voice assignment of vocal quartets, mainly based on convolutional neural networks designed leveraging music domain knowledge. Finally, we propose two methods to characterize vocal unison performances in terms of pitch dispersion.