A 3D descriptor to detect task-oriented grasping points in clothing

Manipulating textile objects with a robot is a challenging task, especially because the garment perception is difficult due to the endless configurations it can adopt, coupled with a large variety of colors and designs. Most current approaches follow a multiple re-grasp strategy, in which clothes ar...

Descripción completa

Detalles Bibliográficos
Autores: Ramisa, Arnau, Alenyà, Guillem, Moreno-Noguer, Francesc, Torras, Carme
Tipo de recurso: artículo
Estado:Versión enviada para evaluación y publicación
Fecha de publicación:2016
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:dnet:digitalcsic_::2160c27b45c790f211bf3aaf8413bb5a
Acceso en línea:http://hdl.handle.net/10261/166275
Access Level:acceso abierto
Palabra clave:Detection
Robotics
Manipulation
Grasping
3D descriptors
Recognition
Descripción
Sumario:Manipulating textile objects with a robot is a challenging task, especially because the garment perception is difficult due to the endless configurations it can adopt, coupled with a large variety of colors and designs. Most current approaches follow a multiple re-grasp strategy, in which clothes are sequentially grasped from different points until one of them yields a recognizable configuration. In this work we propose a method that combines 3D and appearance information to directly select a suitable grasping point for the task at hand, which in our case consists of hanging a shirt or a polo shirt from a hook. Our method follows a coarse-to-fine approach in which, first, the collar of the garment is detected and, next, a grasping point on the lapel is chosen using a novel 3D descriptor. In contrast to current 3D descriptors, ours can run in real time, even when it needs to be densely computed over the input image. Our central idea is to take advantage of the structured nature of range images that most depth sensors provide and, by exploiting integral imaging, achieve speed-ups of two orders of magnitude with respect to competing approaches, while maintaining performance. This makes it especially adequate for robotic applications as we thoroughly demonstrate in the experimental section.