An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia

[EN] The extended use of mobile multimedia devices in applications like gaming, 3D video and audio reproduction, immersive teleconferencing, or virtual and augmented reality, is demanding efficient algorithms and methodologies. All these applications require real-time spatial audio engines with the...

Descripción completa

Detalles Bibliográficos
Autores: Belloch, José A., Badia, Jose M., Cobos, Máximo, Ramos Peinado, Germán|||0000-0001-7152-0044
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/202152
Acceso en línea:https://riunet.upv.es/handle/10251/202152
Access Level:acceso abierto
Palabra clave:Binaural synthesis
HRTF modeling
GPU
Parallel filters
Parametric model
Interpolation
TECNOLOGIA ELECTRONICA
id ES_bea39ef3c91edbcd1243d2cb58b65fc3
oai_identifier_str oai:riunet.upv.es:10251/202152
network_acronym_str ES
network_name_str España
repository_id_str
spelling An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile MultimediaBelloch, José A.Badia, Jose M.Cobos, MáximoRamos Peinado, Germán|||0000-0001-7152-0044Binaural synthesisHRTF modelingGPUParallel filtersParametric modelInterpolationTECNOLOGIA ELECTRONICA[EN] The extended use of mobile multimedia devices in applications like gaming, 3D video and audio reproduction, immersive teleconferencing, or virtual and augmented reality, is demanding efficient algorithms and methodologies. All these applications require real-time spatial audio engines with the capability of dealing with intensive signal processing operations while facing a number of constraints related to computational cost, latency and energy consumption. Most mobile multimedia devices include a Graphics Processing Unit (GPU) that is primarily used to accelerate video processing tasks, providing high computational capabilities due to its inherent parallel architecture. This paper describes a scalable parallel implementation of a real-time binaural audio engine for GPU-equipped mobile devices. The engine is based on a set of head-related transfer functions (HRTFs) modelled with a parametric parallel structure, allowing efficient synthesis and interpolation while reducing the size required for HRTF data storage. Several strategies to optimize the GPU implementation are evaluated over a well-known kind of processor present in a wide range of mobile devices. In this context, we analyze both the energy consumption and real-time capabilities of the system by exploring different GPU and CPU configuration alternatives. Moreover, the implementation has been conducted using the OpenCL framework, guarantying the portability of the code.This work was supported in part by the Spanish Ministry of Economy and Competitiveness under Grant RTI2018-097045-B-C21, Grant RTI2018-097045-B-C22, Grant TIN2017-82972-R, and Grant ESP2015-68245-C4-1-P, and in part by the Universitat Jaume I Project UJI-B2019-36.Institute of Electrical and Electronics EngineersDepartamento de Ingeniería ElectrónicaEscuela Técnica Superior de Ingeniería de TelecomunicaciónInstituto Universitario de Telecomunicación y Aplicaciones MultimediaUniversitat Jaume IAgencia Estatal de InvestigaciónMinisterio de Economía y CompetitividadRepositorio Institucional de la Universitat Politècnica de València Riunet20202020-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://riunet.upv.es/handle/10251/202152reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengAgencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 TIN2017-82972-R TECNICAS ALGORITMICAS PARA COMPUTACION DE ALTO RENDIMIENTO CONSCIENTE DEL CONSUMO ENERGETICO Y RESISTENTE A ERRORESAgencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-097045-B-C21 AUDIO ESPACIAL INTELIGENTE: ANALISIS Y MONITORIZACIONAgencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-097045-B-C22 AUDIO ESPACIAL INTELIGENTE: SINTESIS Y PERSONALIZACIONMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 ESP2015-68245-C4-1-P DISEÑO Y VERIFICACION DE CIRCUITOS ELECTRONICOS A ESCALA NANOMETRICA PARA APLICACIONES ESPACIALES Y TERRESTRES EN AMBIENTES DE RADIACIONUniversitat Jaume I https://doi.org/10.13039/501100004834 UJI-B2019-36open accesshttp://purl.org/coar/access_right/c_abf2Reconocimiento (by)http://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/2021522026-06-13T07:49:27Z
dc.title.none.fl_str_mv An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
title An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
spellingShingle An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
Belloch, José A.
Binaural synthesis
HRTF modeling
GPU
Parallel filters
Parametric model
Interpolation
TECNOLOGIA ELECTRONICA
title_short An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
title_full An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
title_fullStr An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
title_full_unstemmed An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
title_sort An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia
dc.creator.none.fl_str_mv Belloch, José A.
Badia, Jose M.
Cobos, Máximo
Ramos Peinado, Germán|||0000-0001-7152-0044
author Belloch, José A.
author_facet Belloch, José A.
Badia, Jose M.
Cobos, Máximo
Ramos Peinado, Germán|||0000-0001-7152-0044
author_role author
author2 Badia, Jose M.
Cobos, Máximo
Ramos Peinado, Germán|||0000-0001-7152-0044
author2_role author
author
author
dc.contributor.none.fl_str_mv Departamento de Ingeniería Electrónica
Escuela Técnica Superior de Ingeniería de Telecomunicación
Instituto Universitario de Telecomunicación y Aplicaciones Multimedia
Universitat Jaume I
Agencia Estatal de Investigación
Ministerio de Economía y Competitividad
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Binaural synthesis
HRTF modeling
GPU
Parallel filters
Parametric model
Interpolation
TECNOLOGIA ELECTRONICA
topic Binaural synthesis
HRTF modeling
GPU
Parallel filters
Parametric model
Interpolation
TECNOLOGIA ELECTRONICA
description [EN] The extended use of mobile multimedia devices in applications like gaming, 3D video and audio reproduction, immersive teleconferencing, or virtual and augmented reality, is demanding efficient algorithms and methodologies. All these applications require real-time spatial audio engines with the capability of dealing with intensive signal processing operations while facing a number of constraints related to computational cost, latency and energy consumption. Most mobile multimedia devices include a Graphics Processing Unit (GPU) that is primarily used to accelerate video processing tasks, providing high computational capabilities due to its inherent parallel architecture. This paper describes a scalable parallel implementation of a real-time binaural audio engine for GPU-equipped mobile devices. The engine is based on a set of head-related transfer functions (HRTFs) modelled with a parametric parallel structure, allowing efficient synthesis and interpolation while reducing the size required for HRTF data storage. Several strategies to optimize the GPU implementation are evaluated over a well-known kind of processor present in a wide range of mobile devices. In this context, we analyze both the energy consumption and real-time capabilities of the system by exploring different GPU and CPU configuration alternatives. Moreover, the implementation has been conducted using the OpenCL framework, guarantying the portability of the code.
publishDate 2020
dc.date.none.fl_str_mv 2020
2020-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/202152
url https://riunet.upv.es/handle/10251/202152
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Agencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 TIN2017-82972-R TECNICAS ALGORITMICAS PARA COMPUTACION DE ALTO RENDIMIENTO CONSCIENTE DEL CONSUMO ENERGETICO Y RESISTENTE A ERRORES
Agencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-097045-B-C21 AUDIO ESPACIAL INTELIGENTE: ANALISIS Y MONITORIZACION
Agencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-097045-B-C22 AUDIO ESPACIAL INTELIGENTE: SINTESIS Y PERSONALIZACION
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 ESP2015-68245-C4-1-P DISEÑO Y VERIFICACION DE CIRCUITOS ELECTRONICOS A ESCALA NANOMETRICA PARA APLICACIONES ESPACIALES Y TERRESTRES EN AMBIENTES DE RADIACION
Universitat Jaume I https://doi.org/10.13039/501100004834 UJI-B2019-36
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento (by)
http://creativecommons.org/licenses/by/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento (by)
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869418301996662784
score 15,300724

Similares en LA Referencia