Melody extraction from polyphonic music signals

Music was the first mass-market industry to be completely restructured by digital technology, and today we can have access to thousands of tracks stored locally on our smartphone and millions of tracks through cloud-based music services. Given the vast quantity of music at our fingertips, we now req...

Descripción completa

Detalles Bibliográficos
Autor: Salamon, Justin J.
Tipo de recurso: tesis doctoral
Estado:Versión publicada
Fecha de publicación:2013
País:España
Institución:CBUC, CESCA
Repositorio:TDR. Tesis Doctorales en Red
OAI Identifier:oai:www.tdx.cat:10803/123777
Acceso en línea:http://hdl.handle.net/10803/123777
Access Level:acceso abierto
Palabra clave:Melody extraction
Predominant melody estimation
Fundamental frequency
Music information retrieval
Audio content processing
Pitch
Contour
Polyphonic
Music similarity
Version identification
Query by humming
Melody
Bass line
Harmony
Genre classification
Tonic identification
Indian classical music
Flamenco
Automatic music transcription
Melodic transcription
Evaluation methodology
Auditory scene analysis
Melodic contour
Music signal processing
Extracción de melodía
Estimación de la melodía predominante
Frecuencia fundamental
Recuperación de la información musical
Procesado de contenido de audio
Contorno tonal
Polifonía
Semejanza musical
Identificación de versiones
Búsqueda por tarareo
Melodía
Línea de bajo
Clasificación del estilo musical
Identificación de la tónica
Música clásica india
Transcripción automática
Transcripción melódica
Metodología de evaluación
Análisis de la escena auditiva
Contorno melódico
Procesado de señales musicales
Extracció de melodia
Estimació de la melodia predominant
Freqüència fonamental
Recuperació de la informació musical
Processament de contingut d'àudio
Contorn tonal
Polifonia
Semblança musical
Identificació de versions
Recerca per tarareo
Línia de baix
Harmonia
Classificació de l'estil musical
identificació de la tònica
Flamenc
Transcripció automàtica
Transcripció melòdica
Metodologia d'avaluació
Anàlisi de l'escena auditiva
Contorn melòdic
Processament de senyals musicals
78
Descripción
Sumario:Music was the first mass-market industry to be completely restructured by digital technology, and today we can have access to thousands of tracks stored locally on our smartphone and millions of tracks through cloud-based music services. Given the vast quantity of music at our fingertips, we now require novel ways of describing, indexing, searching and interacting with musical content. In this thesis we focus on a technology that opens the door to a wide range of such applications: automatically estimating the pitch sequence of the melody directly from the audio signal of a polyphonic music recording, also referred to as melody extraction. Whilst identifying the pitch of the melody is something human listeners can do quite well, doing this automatically is highly challenging. We present a novel method for melody extraction based on the tracking and characterisation of the pitch contours that form the melodic line of a piece. We show how different contour characteristics can be exploited in combination with auditory streaming cues to identify the melody out of all the pitch content in a music recording using both heuristic and model-based approaches. The performance of our method is assessed in an international evaluation campaign where it is shown to obtain state-of-the-art results. In fact, it achieves the highest mean overall accuracy obtained by any algorithm that has participated in the campaign to date. We demonstrate the applicability of our method both for research and end-user applications by developing systems that exploit the extracted melody pitch sequence for similarity-based music retrieval (version identification and query-by-humming), genre classification, automatic transcription and computational music analysis. The thesis also provides a comprehensive comparative analysis and review of the current state-of-the-art in melody extraction and a first of its kind analysis of melody extraction evaluation methodology.