Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems

[EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the per...

Descripción completa

Detalles Bibliográficos
Autores: Alonso-Jordá, Pedro|||0000-0002-6882-6592, Cortina, Raquel, Rodríguez-Serrano, F.J., Vera-Candeas, P., Alonso-González, M., Ranilla, José
Tipo de recurso: artículo
Fecha de publicación:2017
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/152274
Acceso en línea:https://riunet.upv.es/handle/10251/152274
Access Level:acceso abierto
Palabra clave:Audio-to-Score Alignment
Dynamic Time Warping (DTW)
Score Following
Parallel Computing
Xeon Phi
ARM
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
Descripción
Sumario:[EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the performance and the musical score times. In this work we propose a par- allel online DTW solution based on a client-server architecture. The current version of the application has been implemented for multi-core architectures (x86, x64 and ARM), thus covering either powerful systems or mobile devices. An extensive experimentation has been conducted in order to validate the software. The experiments also show that our framework allows to achieve a good score alignment within the real-time window by using parallel computing techniques.