Hand-object interaction: from human demonstrations to robot manipulation

Human-object interaction is of great relevance for robots to operate in human environments. However, state-of-the-art robotic hands are far from replicating humans skills. It is, therefore, essential to study how humans use their hands to develop similar robotic capabilities. This article presents a...

Descripción completa

Detalles Bibliográficos
Autores: Carfi, Alessandro, Patten, Timothy, Kuang, Yingyi, Hammoud, Ali, Alameh, Mohamad, Maiettini, Elisa, Weinberg, Abraham Itzhak, Faria, Diego, Mastrogiovanni, Fulvio, Alenyà Ribas, Guillem|||0000-0002-6018-154X, Natale, Lorenzo, Perdereau, Veronique, Vincze, Markus, Billard, Aude
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/366126
Acceso en línea:https://hdl.handle.net/2117/366126
https://dx.doi.org/10.3389/frobt.2021.714023
Access Level:acceso abierto
Palabra clave:Robotics
Robots
hand-object interaction
learning from demonstration
imitation learning
transfer learning
grasping
manipulation
anthropomorphic hands
data extraction
Robòtica
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial
Descripción
Sumario:Human-object interaction is of great relevance for robots to operate in human environments. However, state-of-the-art robotic hands are far from replicating humans skills. It is, therefore, essential to study how humans use their hands to develop similar robotic capabilities. This article presents a deep dive into hand-object interaction and human demonstrations, highlighting the main challenges in this research area and suggesting desirable future developments. To this extent, the article presents a general definition of the hand-object interaction problem together with a concise review for each of the main subproblems involved, namely: sensing, perception, and learning. Furthermore, the article discusses the interplay between these subproblems and describes how their interaction in learning from demonstration contributes to the success of robot manipulation. In this way, the article provides a broad overview of the interdisciplinary approaches necessary for a robotic system to learn new manipulation skills by observing human behavior in the real world.