Benchmarking the Sim-to-Real Gap in Cloth Manipulation

Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the real-world. In spite of the extensive use of simulations for this task,...

Descripción completa

Detalles Bibliográficos
Autores: Blanco-Mulero, David, Barbany, Oriol, Alcan, Gokhan, Colomé, Adrià, Torras, Carme, Kyrki, Ville
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/362165
Acceso en línea:http://hdl.handle.net/10261/362165
https://api.elsevier.com/content/abstract/scopus_id/85184332312
Access Level:acceso abierto
Palabra clave:Bimanual manipulation
Data sets for robot learning
Deformable object manipulation
Descripción
Sumario:Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the real-world. In spite of the extensive use of simulations for this task, few works have evaluated the reality gap between deformable object simulators and real-world data. We present a benchmark dataset to evaluate the sim-to-real gap in cloth manipulation. The dataset is collected by performing a dynamic as well as a quasi-static cloth manipulation task involving contact with a rigid table. We use the dataset to evaluate the reality gap, computational time, and simulation stability of four popular deformable object simulators: MuJoCo, Bullet, Flex, and SOFA. Additionally, we discuss the benefits and drawbacks of each simulator. The benchmark dataset is open-source. Supplementary material, videos, and code, can be found at https://sites.google.com/view/cloth-sim2real-benchmark.