Design and experimental validation of an augmented reality system with wireless integration for context aware enhanced show experience in auditoriums

The development of multiple cultural and social related activities, such as shows related with the performing arts, conferences or presentations rely on facilities such as auditoriums, theatres and conference sites, which are progressively including multiple technological features in order to enhanc...

Descripción completa

Detalles Bibliográficos
Autores: Picallo Guembe, Imanol, Vidal Balea, A., Blanco Novoa, Óscar, Iturri López, Peio, Fraga Lamas, Paula, Azpilicueta Fernández de las Heras, Leyre, Falcone Lanas, Francisco, Fernández Caramés, Tiago M., Klaina, Hicham
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2021
País:España
Institución:Universidad Pública de Navarra
Repositorio:Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
OAI Identifier:oai:academica-e.unavarra.es:2454/40002
Acceso en línea:https://hdl.handle.net/2454/40002
Access Level:acceso abierto
Palabra clave:3D ray launching
Auditorium
Augmented reality
Enhanced show experience
HoloLens
Impaired persons
Wireless channel
Descripción
Sumario:The development of multiple cultural and social related activities, such as shows related with the performing arts, conferences or presentations rely on facilities such as auditoriums, theatres and conference sites, which are progressively including multiple technological features in order to enhance user experience. There are still however situations in which user experience is limited owing to lack of environment adaption, such as people with disabilities. In this sense, the adoption of Context Aware paradigms within auditoriums can provide adequate functionalities in order to comply with specific needs. This work is aimed at demonstrating the feasibility in enhancing user experience (e.g., improving the autonomy of disabled people) within auditorium and theatre environments, by means of an Augmented Reality (AR) device (HoloLens smart glasses) with wireless system integration. To carry out the demonstration, different elements to build AR applications are described and tested. First, an intensive measurement campaign was performed in a real auditorium in the city of Pamplona (Baluarte Congress Center) in order to evaluate the feasibility of using Wi-Fi enabled AR devices in a complex wireless propagation scenario. The results show that these environments exhibit high levels of interference, owing to the co-existence and non-coordinated operation of multiple wireless communication systems, such as on site and temporary Wi-Fi access points, wireless microphones or communications systems used by performers, staff and users. Deterministic wireless channel estimation based in volumetric 3D Ray Launching have been obtained for the complete scenario volume, in order to assess quality of service metrics. For illustration purposes, a user-friendly application to help hearing impaired people was developed and its main features were tested in the auditorium. Such an application provides users with a 3D virtual space to visualize useful multimedia content like subtitles or additional information about the show, as well as an integrated call button. © 2013 IEEE.