End-to-end driving via conditional imitation learning

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate an expert cannot be guided to take a specific turn at an upco...

Descripción completa

Detalles Bibliográficos
Autores: Codevilla Moraes, Felipe|||0000-0002-9815-6841, Miiller, Matthias, López Peña, Antonio M.|||0000-0002-6979-5783, Koltun, Vladlen, Dosovitskiy, Alexey
Tipo de recurso: capítulo de libro
Fecha de publicación:2018
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:274763
Acceso en línea:https://ddd.uab.cat/record/274763
https://dx.doi.org/urn:doi:10.1109/ICRA.2018.8460487
Access Level:acceso abierto
Palabra clave:Robot sensing systems
Task analysis
Vehicles
Cameras
Roads
Navigation
Descripción
Sumario:Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate an expert cannot be guided to take a specific turn at an upcoming intersection. This limits the utility of such systems. We propose to condition imitation learning on high-level command input. At test time, the learned driving policy functions as a chauffeur that handles sensorimotor coordination but continues to respond to navigational commands. We evaluate different architectures for conditional imitation learning in vision-based driving. We conduct experiments in realistic three-dimensional simulations of urban driving and on a 1/5 scale robotic truck that is trained to drive in a residential area. Both systems drive based on visual input yet remain responsive to high-level navigational commands.