Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems

[EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the per...

Descripción completa

Detalles Bibliográficos
Autores: Alonso-Jordá, Pedro|||0000-0002-6882-6592, Cortina, Raquel, Rodríguez-Serrano, F.J., Vera-Candeas, P., Alonso-González, M., Ranilla, José
Tipo de recurso: artículo
Fecha de publicación:2017
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/152274
Acceso en línea:https://riunet.upv.es/handle/10251/152274
Access Level:acceso abierto
Palabra clave:Audio-to-Score Alignment
Dynamic Time Warping (DTW)
Score Following
Parallel Computing
Xeon Phi
ARM
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
id ES_cdd2014d6838529cb90ef9e97077dddd
oai_identifier_str oai:riunet.upv.es:10251/152274
network_acronym_str ES
network_name_str España
repository_id_str
spelling Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core SystemsAlonso-Jordá, Pedro|||0000-0002-6882-6592Cortina, RaquelRodríguez-Serrano, F.J.Vera-Candeas, P.Alonso-González, M.Ranilla, JoséAudio-to-Score AlignmentDynamic Time Warping (DTW)Score FollowingParallel ComputingXeon PhiARMCIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL[EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the performance and the musical score times. In this work we propose a par- allel online DTW solution based on a client-server architecture. The current version of the application has been implemented for multi-core architectures (x86, x64 and ARM), thus covering either powerful systems or mobile devices. An extensive experimentation has been conducted in order to validate the software. The experiments also show that our framework allows to achieve a good score alignment within the real-time window by using parallel computing techniques.This work has been partially supported by Spanish Ministry of Science and Innovation and FEDER under Projects TEC2012-38142-C04-01, TEC2012-38142-C04-03, TEC2012-38142-C04-04, TEC2015-67387-C4-1-R, TEC2015-67387-C4-3-R, TEC2015-67387-C4-4-R, the European Union FEDER (CAPAP-H5 network TIN2014-53522-REDT), and the Generalitat Valenciana under Grant PROMETEOII/2014/003.Springer-VerlagDepartamento de Sistemas Informáticos y ComputaciónEscuela Técnica Superior de Ingeniería InformáticaGeneralitat ValencianaEuropean Regional Development FundMinisterio de Economía y CompetitividadRepositorio Institucional de la Universitat Politècnica de València Riunet20172017-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/152274reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-3-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING: SMART COMPUTINGMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-1-R SMART SOUND PROCESSING FOR THE DIGITAL LIVINGMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-01 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: CONTROL ACTIVOMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-03 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: INTERPRETACION DE MUSICA EN DIRECTO.Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-04 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: COMPUTACION DISTRIBUIDAMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-4-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING: COGNITIVE LISTENINGMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2014-53522-REDT RED DE COMPUTACION DE ALTAS PRESTACIONES EN ARQUITECTURAS HETEROGENEAS (CAPAP-H5)Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEOII%2F2014%2F003 Computación y comunicaciones de altas prestaciones y aplicaciones en ingenieríaopen accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1522742026-06-13T07:49:27Z
dc.title.none.fl_str_mv Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
title Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
spellingShingle Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
Alonso-Jordá, Pedro|||0000-0002-6882-6592
Audio-to-Score Alignment
Dynamic Time Warping (DTW)
Score Following
Parallel Computing
Xeon Phi
ARM
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
title_short Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
title_full Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
title_fullStr Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
title_full_unstemmed Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
title_sort Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems
dc.creator.none.fl_str_mv Alonso-Jordá, Pedro|||0000-0002-6882-6592
Cortina, Raquel
Rodríguez-Serrano, F.J.
Vera-Candeas, P.
Alonso-González, M.
Ranilla, José
author Alonso-Jordá, Pedro|||0000-0002-6882-6592
author_facet Alonso-Jordá, Pedro|||0000-0002-6882-6592
Cortina, Raquel
Rodríguez-Serrano, F.J.
Vera-Candeas, P.
Alonso-González, M.
Ranilla, José
author_role author
author2 Cortina, Raquel
Rodríguez-Serrano, F.J.
Vera-Candeas, P.
Alonso-González, M.
Ranilla, José
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Técnica Superior de Ingeniería Informática
Generalitat Valenciana
European Regional Development Fund
Ministerio de Economía y Competitividad
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Audio-to-Score Alignment
Dynamic Time Warping (DTW)
Score Following
Parallel Computing
Xeon Phi
ARM
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
topic Audio-to-Score Alignment
Dynamic Time Warping (DTW)
Score Following
Parallel Computing
Xeon Phi
ARM
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
description [EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the performance and the musical score times. In this work we propose a par- allel online DTW solution based on a client-server architecture. The current version of the application has been implemented for multi-core architectures (x86, x64 and ARM), thus covering either powerful systems or mobile devices. An extensive experimentation has been conducted in order to validate the software. The experiments also show that our framework allows to achieve a good score alignment within the real-time window by using parallel computing techniques.
publishDate 2017
dc.date.none.fl_str_mv 2017
2017-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/152274
url https://riunet.upv.es/handle/10251/152274
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-3-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING: SMART COMPUTING
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-1-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-01 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: CONTROL ACTIVO
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-03 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: INTERPRETACION DE MUSICA EN DIRECTO.
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2012-38142-C04-04 PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: COMPUTACION DISTRIBUIDA
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TEC2015-67387-C4-4-R SMART SOUND PROCESSING FOR THE DIGITAL LIVING: COGNITIVE LISTENING
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2014-53522-REDT RED DE COMPUTACION DE ALTAS PRESTACIONES EN ARQUITECTURAS HETEROGENEAS (CAPAP-H5)
Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEOII%2F2014%2F003 Computación y comunicaciones de altas prestaciones y aplicaciones en ingeniería
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Springer-Verlag
publisher.none.fl_str_mv Springer-Verlag
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869419889694867456
score 15.301603

Similares en LA Referencia