Manipulación visual-táctil para la recogida de residuos domésticos en exteriores

[EN] This work presents a perception system applied to robotic manipulation, that is able to assist in navegation, household waste classification and collection in outdoor environments. This system is made up of optical tactile sensors, RGBD cameras and a LiDAR. These sensors are integrated on a mob...

Descripción completa

Detalles Bibliográficos
Autores: Castaño-Amorós, Julio, Páez-Ubieta, Ignacio de Loyola, Gil, Pablo, Puente, Santiago Timoteo
Tipo de recurso: artículo
Fecha de publicación:2023
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:español
OAI Identifier:oai:riunet.upv.es:10251/192800
Acceso en línea:https://riunet.upv.es/handle/10251/192800
Access Level:acceso abierto
Palabra clave:Visual detection
Object recognition
Object location
Tactile perception
Robotic manipulation
Detección visual
Reconocimiento de objetos
Localización de objetos
Percepción táctil
Manipulación robótica
Descripción
Sumario:[EN] This work presents a perception system applied to robotic manipulation, that is able to assist in navegation, household waste classification and collection in outdoor environments. This system is made up of optical tactile sensors, RGBD cameras and a LiDAR. These sensors are integrated on a mobile platform with a robot manipulator and a robotic gripper. Our system is divided in three software modules, two of them are vision-based and the last one is tactile-based. The vision-based modules use CNNs to localize and recognize solid household waste, together with the grasping points estimation. The tactile-based module, which also uses CNNs and image processing, adjusts the gripper opening to control the grasping from touch data. Our proposal achieves localization errors around 6 %, a recognition accuracy of 98% and ensures the grasping stability the 91% of the attempts. The sum of runtimes of the three modules is less than 750 ms.