Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perfor...

Full description

Bibliographic Details
Authors: Rivera Pinto, Andoni, Kildal, Johan, Lazkano Ortega, Elena
Format: article
Publication Date:2020
Country:España
Institution:Universidad del País Vasco
Repository:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/49635
Online Access:http://hdl.handle.net/10810/49635
Access Level:Open access
Keyword:human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
id ES_ea7c4bf6a6e149bb4268fc045a3bfcd1
oai_identifier_str oai:addi.ehu.eus:10810/49635
network_acronym_str ES
network_name_str España
repository_id_str
spelling Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic CobotRivera Pinto, AndoniKildal, JohanLazkano Ortega, Elenahuman–robot interactioncobotaugmented realitymid-air hapticshologrammultimodalIn the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.MDPI2021202120202020info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10810/49635reponame:Addi. Archivo Digital para la Docencia y la Investigacióninstname:Universidad del País VascoIngléshttps://www.mdpi.com/2414-4088/4/4/78/htminfo:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by/3.0/es/2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).oai:addi.ehu.eus:10810/496352026-06-18T09:23:17Z
dc.title.none.fl_str_mv Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
spellingShingle Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
Rivera Pinto, Andoni
human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
title_short Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_full Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_fullStr Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_full_unstemmed Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_sort Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
dc.creator.none.fl_str_mv Rivera Pinto, Andoni
Kildal, Johan
Lazkano Ortega, Elena
author Rivera Pinto, Andoni
author_facet Rivera Pinto, Andoni
Kildal, Johan
Lazkano Ortega, Elena
author_role author
author2 Kildal, Johan
Lazkano Ortega, Elena
author2_role author
author
dc.subject.none.fl_str_mv human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
topic human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
description In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.
publishDate 2020
dc.date.none.fl_str_mv 2020
2020
2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10810/49635
url http://hdl.handle.net/10810/49635
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv https://www.mdpi.com/2414-4088/4/4/78/htm
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by/3.0/es/
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/3.0/es/
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:Addi. Archivo Digital para la Docencia y la Investigación
instname:Universidad del País Vasco
instname_str Universidad del País Vasco
reponame_str Addi. Archivo Digital para la Docencia y la Investigación
collection Addi. Archivo Digital para la Docencia y la Investigación
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869423144152858624
score 15,300724

Similar Items