Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perfor...

Descripción completa

Detalles Bibliográficos
Autores: Rivera Pinto, Andoni, Kildal, Johan, Lazkano Ortega, Elena
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universidad del País Vasco
Repositorio:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/49635
Acceso en línea:http://hdl.handle.net/10810/49635
Access Level:acceso abierto
Palabra clave:human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
Descripción
Sumario:In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.