A Deep Learning Model for Markerless Pose Estimation Based on Keypoint Augmentation: What Factors Influence Errors in Biomechanical Applications?

[EN] In biomechanics, movement is typically recorded by tracking the trajectories of anatomical landmarks previously marked using passive instrumentation, which entails several inconveniences. To overcome these disadvantages, researchers are exploring different markerless methods, such as pose estim...

ver descrição completa

Detalhes bibliográficos
Autores: RUESCAS NICOLAU, ANA VIRGINIA, Medina Ripoll, Enrique, De Rosario Martínez, Helios, Sanchiz Navarro, Joaquin, Parrilla Bernabé, Eduardo, Juan, M. Carmen|||0000-0002-8764-1470
Tipo de documento: artigo
Data de publicação:2024
País:España
Recursos:Universitat Politècnica de València (UPV)
Repositório:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglês
OAI Identifier:oai:riunet.upv.es:10251/203678
Acesso em linha:https://riunet.upv.es/handle/10251/203678
Access Level:Acceso aberto
Palavra-chave:Markerless
Deep learning
Anatomical landmark
Human pose estimation
Biomechanics
Keypoint augmentation
LENGUAJES Y SISTEMAS INFORMATICOS
Descrição
Resumo:[EN] In biomechanics, movement is typically recorded by tracking the trajectories of anatomical landmarks previously marked using passive instrumentation, which entails several inconveniences. To overcome these disadvantages, researchers are exploring different markerless methods, such as pose estimation networks, to capture movement with equivalent accuracy to marker-based photogrammetry. However, pose estimation models usually only provide joint centers, which are incomplete data for calculating joint angles in all anatomical axes. Recently, marker augmentation models based on deep learning have emerged. These models transform pose estimation data into complete anatomical data. Building on this concept, this study presents three marker augmentation models of varying complexity that were compared to a photogrammetry system. The errors in anatomical landmark positions and the derived joint angles were calculated, and a statistical analysis of the errors was performed to identify the factors that most influence their magnitude. The proposed Transformer model improved upon the errors reported in the literature, yielding position errors of less than 1.5 cm for anatomical landmarks and 4.4 degrees for all seven movements evaluated. Anthropometric data did not influence the errors, while anatomical landmarks and movement influenced position errors, and model, rotation axis, and movement influenced joint angle errors.