Enhancing autonomous driving in urban scenarios: a hybrid approach with reinforcement learning and classical control

The use of Deep Learning algorithms in the domain of Decision Making for Autonomous Vehicles has garnered significant attention in the literature in recent years, showcasing considerable potential. Nevertheless, most of the solutions proposed by the scientific community encounter difficulties in rea...

Descripción completa

Detalles Bibliográficos
Autores: Gutiérrez Moreno, Rodrigo, Barea Navarro, Rafael|||0000-0002-4179-6100, López Guillén, María Elena, Arango Vargas, Juan Felipe|||0000-0003-4989-9443, Sánchez García, Fabio, Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universidad de Alcalá (UAH)
Repositorio:e_Buah Biblioteca Digital Universidad de Alcalá
Idioma:inglés
OAI Identifier:oai:ebuah.uah.es:10017/64477
Acceso en línea:http://hdl.handle.net/10017/64477
https://dx.doi.org/10.3390/s25010117
Access Level:acceso abierto
Palabra clave:Autonomous driving
Deep reinforcement learning
Decision-making
Vehicle control
CARLA simulator
Electrónica
Electronics
Descripción
Sumario:The use of Deep Learning algorithms in the domain of Decision Making for Autonomous Vehicles has garnered significant attention in the literature in recent years, showcasing considerable potential. Nevertheless, most of the solutions proposed by the scientific community encounter difficulties in real-world applications. This paper aims to provide a realistic implementation of a hybrid Decision Making module in an Autonomous Driving stack, integrating the learning capabilities from the experience of Deep Reinforcement Learning algorithms and the reliability of classical methodologies. Our Decision Making system is in charge of generating steering and velocity signals using the HD map information and sensors pre-processed data. This work encompasses the implementation of concatenated scenarios in simulated environments, and the integration of Autonomous Driving modules. Specifically, the authors address the Decision Making problem by employing a Partially Observable Markov Decision Process formulation and offer a solution through the use of Deep Reinforcement Learning algorithms. Furthermore, an additional control module to execute the decisions in a safe and comfortable way through a hybrid architecture is presented. The proposed architecture is validated in the CARLA simulator by navigating through multiple concatenated scenarios, outperforming the CARLA Autopilot in terms of completion time, while ensuring both safety and comfort.