Online score-informed source separation in polyphonic mixtures using instrument spectral patterns

[EN] Soundprism is a real-time algorithm to separate polyphonic music audio into source signals, given the musical score of the audio in advance. This paper presents a framework for a Soundprism implementation. A study of the sound quality of the online score-informed source separation is shown, alt...

Descripción completa

Detalles Bibliográficos
Autores: Muñoz-Montoro, A., Vera-Candeas, P., Cortina, Raquel, Combarro, E. F., Alonso-Jordá, Pedro|||0000-0002-6882-6592
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/123507
Acceso en línea:https://riunet.upv.es/handle/10251/123507
Access Level:acceso abierto
Palabra clave:Sound source separation
NMF
Dynamic Time Warping
Online
Score-informed
Score-alignment
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
Descripción
Sumario:[EN] Soundprism is a real-time algorithm to separate polyphonic music audio into source signals, given the musical score of the audio in advance. This paper presents a framework for a Soundprism implementation. A study of the sound quality of the online score-informed source separation is shown, although a real-time implementation is not carried out. The system is compound of two stages: (1) a score follower that matches a MIDI score position to each time frame of the musical performance; and (2) a source separator based on a nonnegative matrix factorization approach guided by the score. Real audio mixtures composed of an instrumental quartets were employed to obtain preliminary results of the proposed system.