The music demixing machine: toward real-time remixing of classical music

Classical music, unlike popular music, is usually recorded live with close microphone techniques. For this reason, isolated tracks are not available to create the final mixture/stream, and so the mixing process requires greater effort. Source separation methods are a potential solution to this probl...

Descripción completa

Detalles Bibliográficos
Autores: Cabañas-Molero, Pablo Antonio, Muñoz-Montoro, Antonio Jesús, Vera-Candeas, Pedro, Ranilla, José
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2023
País:España
Institución:Universidad de Jaén
Repositorio:RUJA. Repositorio Institucional de la Producción Científica de la Universidad de Jaén
OAI Identifier:oai:ruja.ujaen.es:10953/2194
Acceso en línea:https://hdl.handle.net/10953/2194
Access Level:acceso abierto
Palabra clave:Classical music
High performance computing
Multichannel NMF
Music source separation
Real time
621.39
Descripción
Sumario:Classical music, unlike popular music, is usually recorded live with close microphone techniques. For this reason, isolated tracks are not available to create the final mixture/stream, and so the mixing process requires greater effort. Source separation methods are a potential solution to this problem. However, current algorithms are not fast enough to yield real-time separation in professional setups with dozens of microphones and sources. In this paper, we propose a fast approach consisting of a panning-based multichannel non-negative matrix factorization model to separate classical music. We tested the system on real professional recordings, where we were able to reach real-time with very low latency and promising quality.