Driver Take-Over Behaviour Study Based on Gaze Focalization and Vehicle Data in CARLA Simulator

Autonomous vehicles are the near future of the automobile industry. However, until they reach Level 5, humans and cars will share this intermediate future. Therefore, studying the transition between autonomous and manual modes is a fascinating topic. Automated vehicles may still need to occasionally...

Descripción completa

Detalles Bibliográficos
Autores: Araluce Ruiz, Javier, Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077, Ocaña Miguel, Manuel|||0000-0002-8875-1866, López Guillén, María Elena, Gutiérrez Moreno, Rodrigo, Arango Vargas, Juan Felipe|||0000-0003-4989-9443
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universidad de Alcalá (UAH)
Repositorio:e_Buah Biblioteca Digital Universidad de Alcalá
Idioma:inglés
OAI Identifier:oai:ebuah.uah.es:10017/63103
Acceso en línea:http://hdl.handle.net/10017/63103
https://dx.doi.org/10.3390/s22249993
Access Level:acceso abierto
Palabra clave:Gaze focalization
Driving behaviour study
CARLA simulator
Non-driving-related tasks (NDRTs)
Take-over time
Take-over quality
Driver situation awareness
Electrónica
Electronics
Descripción
Sumario:Autonomous vehicles are the near future of the automobile industry. However, until they reach Level 5, humans and cars will share this intermediate future. Therefore, studying the transition between autonomous and manual modes is a fascinating topic. Automated vehicles may still need to occasionally hand the control to drivers due to technology limitations and legal requirements. This paper presents a study of driver behaviour in the transition between autonomous and manual modes using a CARLA simulator. To our knowledge, this is the first take-over study with transitions conducted on this simulator. For this purpose, we obtain driver gaze focalization and fuse it with the road’s semantic segmentation to track to where and when the user is paying attention, besides the actuators’ reaction-time measurements provided in the literature. To track gaze focalization in a non-intrusive and inexpensive way, we use a method based on a camera developed in previous works. We devised it with the OpenFace 2.0 toolkit and a NARMAX calibration method. It transforms the face parameters extracted by the toolkit into the point where the user is looking on the simulator scene. The study was carried out by different users using our simulator, which is composed of three screens, a steering wheel and pedals. We distributed this proposal in two different computer systems due to the computational cost of the simulator based on the CARLA simulator. The robot operating system (ROS) framework is in charge of the communication of both systems to provide portability and flexibility to the proposal. Results of the transition analysis are provided using state-of-the-art metrics and a novel driver situation-awareness metric for 20 users in two different scenarios.