Online score-informed source separation in polyphonic mixtures using instrument spectral patterns

[EN] Soundprism is a real-time algorithm to separate polyphonic music audio into source signals, given the musical score of the audio in advance. This paper presents a framework for a Soundprism implementation. A study of the sound quality of the online score-informed source separation is shown, alt...

Descripción completa

Detalles Bibliográficos
Autores: Muñoz-Montoro, A., Vera-Candeas, P., Cortina, Raquel, Combarro, E. F., Alonso-Jordá, Pedro|||0000-0002-6882-6592
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/123507
Acceso en línea:https://riunet.upv.es/handle/10251/123507
Access Level:acceso abierto
Palabra clave:Sound source separation
NMF
Dynamic Time Warping
Online
Score-informed
Score-alignment
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
id ES_4cd709fc3a7d545a40dad954fc95bc53
oai_identifier_str oai:riunet.upv.es:10251/123507
network_acronym_str ES
network_name_str España
repository_id_str
spelling Online score-informed source separation in polyphonic mixtures using instrument spectral patternsMuñoz-Montoro, A.Vera-Candeas, P.Cortina, RaquelCombarro, E. F.Alonso-Jordá, Pedro|||0000-0002-6882-6592Sound source separationNMFDynamic Time WarpingOnlineScore-informedScore-alignmentCIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL[EN] Soundprism is a real-time algorithm to separate polyphonic music audio into source signals, given the musical score of the audio in advance. This paper presents a framework for a Soundprism implementation. A study of the sound quality of the online score-informed source separation is shown, although a real-time implementation is not carried out. The system is compound of two stages: (1) a score follower that matches a MIDI score position to each time frame of the musical performance; and (2) a source separator based on a nonnegative matrix factorization approach guided by the score. Real audio mixtures composed of an instrumental quartets were employed to obtain preliminary results of the proposed system.Ministerio de Economía y Competitividad. Grant Number: TEC2015-67387-C4-{1, 2, 3}-RJohn Wiley & SonsDepartamento de Sistemas Informáticos y ComputaciónEscuela Técnica Superior de Ingeniería InformáticaMinisterio de Economía y EmpresaRepositorio Institucional de la Universitat Politècnica de València Riunet20192019-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/123507reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-1-R SMART SOUND PROCESSING FOR THE DIGITAL LIVINGopen accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1235072026-06-13T07:49:27Z
dc.title.none.fl_str_mv Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
title Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
spellingShingle Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
Muñoz-Montoro, A.
Sound source separation
NMF
Dynamic Time Warping
Online
Score-informed
Score-alignment
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
title_short Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
title_full Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
title_fullStr Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
title_full_unstemmed Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
title_sort Online score-informed source separation in polyphonic mixtures using instrument spectral patterns
dc.creator.none.fl_str_mv Muñoz-Montoro, A.
Vera-Candeas, P.
Cortina, Raquel
Combarro, E. F.
Alonso-Jordá, Pedro|||0000-0002-6882-6592
author Muñoz-Montoro, A.
author_facet Muñoz-Montoro, A.
Vera-Candeas, P.
Cortina, Raquel
Combarro, E. F.
Alonso-Jordá, Pedro|||0000-0002-6882-6592
author_role author
author2 Vera-Candeas, P.
Cortina, Raquel
Combarro, E. F.
Alonso-Jordá, Pedro|||0000-0002-6882-6592
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Técnica Superior de Ingeniería Informática
Ministerio de Economía y Empresa
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Sound source separation
NMF
Dynamic Time Warping
Online
Score-informed
Score-alignment
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
topic Sound source separation
NMF
Dynamic Time Warping
Online
Score-informed
Score-alignment
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
description [EN] Soundprism is a real-time algorithm to separate polyphonic music audio into source signals, given the musical score of the audio in advance. This paper presents a framework for a Soundprism implementation. A study of the sound quality of the online score-informed source separation is shown, although a real-time implementation is not carried out. The system is compound of two stages: (1) a score follower that matches a MIDI score position to each time frame of the musical performance; and (2) a source separator based on a nonnegative matrix factorization approach guided by the score. Real audio mixtures composed of an instrumental quartets were employed to obtain preliminary results of the proposed system.
publishDate 2019
dc.date.none.fl_str_mv 2019
2019-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/123507
url https://riunet.upv.es/handle/10251/123507
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-1-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv John Wiley & Sons
publisher.none.fl_str_mv John Wiley & Sons
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869407652981768192
score 15,300719