Real-time semantic segmentation for fisheye urban driving images based on ERFNet

The interest in fisheye cameras has recently risen in the autonomous vehicles field, as they are able to reduce the complexity of perception systems while improving the management of dangerous driving situations. However, the strong distortion inherent to these cameras makes the usage of conventiona...

Descripción completa

Detalles Bibliográficos
Autores: Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077, Saez Contreras, Álvaro, López Guillén, María Elena, Romera Carmena, Eduardo|||0000-0001-6250-6160, Tradacete Ágreda, Miguel|||0000-0002-9255-8532, Gómez Huélamo, Carlos, Egido Sierra, Javier del
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universidad de Alcalá (UAH)
Repositorio:e_Buah Biblioteca Digital Universidad de Alcalá
Idioma:inglés
OAI Identifier:oai:ebuah.uah.es:10017/43126
Acceso en línea:http://hdl.handle.net/10017/43126
https://dx.doi.org/10.3390/s19030503
Access Level:acceso abierto
Palabra clave:Fisheye
Intelligent vehicles
CNN (Convolutional Neural Network)
Deep Learning
Distortion
Electrónica
Electronics
Descripción
Sumario:The interest in fisheye cameras has recently risen in the autonomous vehicles field, as they are able to reduce the complexity of perception systems while improving the management of dangerous driving situations. However, the strong distortion inherent to these cameras makes the usage of conventional computer vision algorithms difficult and has prevented the development of these devices. This paper presents a methodology that provides real-time semantic segmentation on fisheye cameras leveraging only synthetic images. Furthermore, we propose some Convolutional Neural Networks (CNN) architectures based on Efficient Residual Factorized Network (ERFNet) that demonstrate notable skills handling distortion and a new training strategy that improves the segmentation on the image borders. Our proposals are compared to similar state-of-the-art works showing an outstanding performance and tested in an unknown real world scenario using a fisheye camera integrated in an open-source autonomous electric car, showing a high domain adaptation capability.