A Tool for Incorporating Eye Tracking Data in RPA: Enhancing User Behavior Logs

This paper presents UBGI, an innovative tool designed to enhance Robotic Process Automation (RPA) by integrating eye tracking data with user interface (UI) logs. UBGI processes and combines gaze logs with UI logs to create enriched User Behaviour (UB) logs, enabling more precise identification of us...

Descripción completa

Detalles Bibliográficos
Autores: García Romero, Manuel, Martínez Rojas, Antonio, González Enríquez, José, Jiménez Ramírez, Andrés
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/162477
Acceso en línea:https://hdl.handle.net/11441/162477
Access Level:acceso abierto
Palabra clave:Robotic Process Automation
Robotic Process Mining
User Behaviour Mining
User Behaviour Log
Eye Tracking
Descripción
Sumario:This paper presents UBGI, an innovative tool designed to enhance Robotic Process Automation (RPA) by integrating eye tracking data with user interface (UI) logs. UBGI processes and combines gaze logs with UI logs to create enriched User Behaviour (UB) logs, enabling more precise identification of user focus areas. By applying filtering masks to screenshots, UBGI highlights relevant data, facilitating analysis of user interactions. This tool enables further analysis of user behaviour through an external source, specifically eye tracking data.