Learning Priors of Human Motion with Vision Transformers

A clear understanding of where humans move in a scenario, their usual paths and speeds, and where they stop, is very important for different applications, such as mobility studies in urban areas or robot navigation tasks within human-populated environments. We propose in this article, a neural archi...

Descripción completa

Detalles Bibliográficos
Autores: Falqueto, Placido, Sanfeliu, Alberto, Palopoli, Luigi, Fontanelli, Daniele
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2024
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/388045
Acceso en línea:http://hdl.handle.net/10261/388045
https://api.elsevier.com/content/abstract/scopus_id/85204095548
Access Level:acceso abierto
Palabra clave:Human motion prediction
Masked autoencoders
Occupancy priors
Semantic scene understanding
Vision transformers
Descripción
Sumario:A clear understanding of where humans move in a scenario, their usual paths and speeds, and where they stop, is very important for different applications, such as mobility studies in urban areas or robot navigation tasks within human-populated environments. We propose in this article, a neural architecture based on Vision Transformers (ViTs) to provide this information. This solution can arguably capture spatial correlations more effectively than Convolutional Neural Networks (CNNs). In the paper, we describe the methodology and proposed neural architecture and show the experiments' results with a standard dataset. We show that the proposed ViT architecture improves the metrics compared to a method based on a CNN.