A benchmark for point clouds registration algorithms

Point clouds registration is a fundamental step of many point clouds processing pipelines; however, most algorithms are tested on data that are collected ad-hoc and not shared with the research community. These data often cover only a very limited set of use cases; therefore, the results cannot be g...

Full description

Bibliographic Details
Authors: Fontana, Simone, Cattaneo, Daniele, Ballardini, Augusto Luis|||0000-0001-6688-5081, Vaghi, Matteo, Sorrenti, Domenico Giorgio
Format: article
Publication Date:2021
Country:España
Institution:Universidad de Alcalá (UAH)
Repository:e_Buah Biblioteca Digital Universidad de Alcalá
Language:English
OAI Identifier:oai:ebuah.uah.es:10017/63254
Online Access:http://hdl.handle.net/10017/63254
https://dx.doi.org/10.1016/j.robot.2021.103734
Access Level:Open access
Keyword:Benchmark
Point clouds registration
Datasets
Robótica e Informática Industrial
Robotics
Description
Summary:Point clouds registration is a fundamental step of many point clouds processing pipelines; however, most algorithms are tested on data that are collected ad-hoc and not shared with the research community. These data often cover only a very limited set of use cases; therefore, the results cannot be generalized. Public datasets proposed until now, taken individually, cover only a few kinds of environment and mostly a single sensor. For these reasons, we developed a benchmark, for localization and mapping applications, using multiple publicly available datasets. In this way, we are able to cover many kinds of environment and many kinds of sensor that can produce point clouds. Furthermore, the ground truth has been thoroughly inspected and evaluated to ensure its quality. For some of the datasets, the accuracy of the ground truth measuring system was not reported by the original authors, therefore we estimated it with our own novel method, based on an iterative registration algorithm. Along with the data, we provide a broad set of registration problems, chosen to cover different types of initial misalignment, various degrees of overlap, and different kinds of registration problems. Lastly, we propose a metric to measure the performances of registration algorithms: it combines the commonly used rotation and translation errors together, to allow an objective comparison of the alignments. This work aims at encouraging authors to use a public and shared benchmark, instead of data collected ad-hoc, to ensure objectivity and repeatability, two fundamental characteristics in any scientific field.