Design of a virtual assistant to improve interaction between the audience and the presenter

This article presents a novel design of a Virtual Assistant as part of a human-machine interaction system to improve communication between the presenter and the audience that can be used in education or general presentations for improving interaction during the presentations (e.g., auditoriums with...

ver descrição completa

Detalhes bibliográficos
Autores: Cobos Guzman, Salvador, Nuere Menendez-Pidal, Silvia, de Miguel Álvarez, Laura, König, Caroline|||0000-0002-7543-8686
Formato: artículo
Fecha de publicación:2021
País:España
Recursos:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/422954
Acesso em linha:https://hdl.handle.net/2117/422954
https://dx.doi.org/10.9781/ijimai.2021.08.017
Access Level:acceso abierto
Palavra-chave:AI
Human-machine
Interaction
Learning
Multimedia
Virtual assistance
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Interacció home-màquina
id ES_80ea9e72f1baa3cd260b2cb45397d119
oai_identifier_str oai:upcommons.upc.edu:2117/422954
network_acronym_str ES
network_name_str España
repository_id_str
spelling Design of a virtual assistant to improve interaction between the audience and the presenterCobos Guzman, SalvadorNuere Menendez-Pidal, Silviade Miguel Álvarez, LauraKönig, Caroline|||0000-0002-7543-8686AIHuman-machineInteractionLearningMultimediaVirtual assistanceÀrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Interacció home-màquinaThis article presents a novel design of a Virtual Assistant as part of a human-machine interaction system to improve communication between the presenter and the audience that can be used in education or general presentations for improving interaction during the presentations (e.g., auditoriums with 200 people). The main goal of the proposed model is the design of a framework of interaction to increase the level of attention of the public in key aspects of the presentation. In this manner, the collaboration between the presenter and Virtual Assistant could improve the level of learning among the public. The design of the Virtual Assistant relies on non-anthropomorphic forms with ‘live’ characteristics generating an intuitive and self-explainable interface. A set of intuitive and useful virtual interactions to support the presenter was designed. This design was validated from various types of the public with a psychological study based on a discrete emotions’ questionnaire confirming the adequacy of the proposed solution. The human-machine interaction system supporting the Virtual Assistant should automatically recognize the attention level of the audience from audiovisual resources and synchronize the Virtual Assistant with the presentation. The system involves a complex artificial intelligence architecture embracing perception of high-level features from audio and video, knowledge representation, and reasoning for pervasive and affective computing and reinforcement learning to teach the intelligent agent to decide on the best strategy to increase the level of attention of the audience.Peer Reviewed20212021-12-0120252025-01-28journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/422954https://dx.doi.org/10.9781/ijimai.2021.08.017reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Attribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/4229542026-05-27T15:37:01Z
dc.title.none.fl_str_mv Design of a virtual assistant to improve interaction between the audience and the presenter
title Design of a virtual assistant to improve interaction between the audience and the presenter
spellingShingle Design of a virtual assistant to improve interaction between the audience and the presenter
Cobos Guzman, Salvador
AI
Human-machine
Interaction
Learning
Multimedia
Virtual assistance
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Interacció home-màquina
title_short Design of a virtual assistant to improve interaction between the audience and the presenter
title_full Design of a virtual assistant to improve interaction between the audience and the presenter
title_fullStr Design of a virtual assistant to improve interaction between the audience and the presenter
title_full_unstemmed Design of a virtual assistant to improve interaction between the audience and the presenter
title_sort Design of a virtual assistant to improve interaction between the audience and the presenter
dc.creator.none.fl_str_mv Cobos Guzman, Salvador
Nuere Menendez-Pidal, Silvia
de Miguel Álvarez, Laura
König, Caroline|||0000-0002-7543-8686
author Cobos Guzman, Salvador
author_facet Cobos Guzman, Salvador
Nuere Menendez-Pidal, Silvia
de Miguel Álvarez, Laura
König, Caroline|||0000-0002-7543-8686
author_role author
author2 Nuere Menendez-Pidal, Silvia
de Miguel Álvarez, Laura
König, Caroline|||0000-0002-7543-8686
author2_role author
author
author
dc.subject.none.fl_str_mv AI
Human-machine
Interaction
Learning
Multimedia
Virtual assistance
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Interacció home-màquina
topic AI
Human-machine
Interaction
Learning
Multimedia
Virtual assistance
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Interacció home-màquina
description This article presents a novel design of a Virtual Assistant as part of a human-machine interaction system to improve communication between the presenter and the audience that can be used in education or general presentations for improving interaction during the presentations (e.g., auditoriums with 200 people). The main goal of the proposed model is the design of a framework of interaction to increase the level of attention of the public in key aspects of the presentation. In this manner, the collaboration between the presenter and Virtual Assistant could improve the level of learning among the public. The design of the Virtual Assistant relies on non-anthropomorphic forms with ‘live’ characteristics generating an intuitive and self-explainable interface. A set of intuitive and useful virtual interactions to support the presenter was designed. This design was validated from various types of the public with a psychological study based on a discrete emotions’ questionnaire confirming the adequacy of the proposed solution. The human-machine interaction system supporting the Virtual Assistant should automatically recognize the attention level of the audience from audiovisual resources and synchronize the Virtual Assistant with the presentation. The system involves a complex artificial intelligence architecture embracing perception of high-level features from audio and video, knowledge representation, and reasoning for pervasive and affective computing and reinforcement learning to teach the intelligent agent to decide on the best strategy to increase the level of attention of the audience.
publishDate 2021
dc.date.none.fl_str_mv 2021
2021-12-01
2025
2025-01-28
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/422954
https://dx.doi.org/10.9781/ijimai.2021.08.017
url https://hdl.handle.net/2117/422954
https://dx.doi.org/10.9781/ijimai.2021.08.017
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869411935374540800
score 15,81155