Deep Learning Enhanced Multisensor Data Fusion for Building Assessment Using Multispectral Voxels and Self-Organizing Maps

[EN] Efforts in the domain of building studies involve the use of a diverse array of geomatic sensors, some providing invaluable information in the form of three-dimensional point clouds and associated registered properties. However, managing the vast amounts of data generated by these sensors prese...

Descripción completa

Detalles Bibliográficos
Autores: Raimundo, Javier, Lopez-Cuervo Medina, Serafin, Aguirre de Mata, Julián, Herrero-Tejedor, Tomas Ramón, Priego De Los Santos, Enrique|||0000-0001-6642-7806
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/212974
Acceso en línea:https://riunet.upv.es/handle/10251/212974
Access Level:acceso abierto
Palabra clave:Multisensor
Data fusion
Voxel
Multispectral
Building
Point cloud
Cultural heritage
INGENIERIA CARTOGRAFICA, GEODESIA Y FOTOGRAMETRIA
Descripción
Sumario:[EN] Efforts in the domain of building studies involve the use of a diverse array of geomatic sensors, some providing invaluable information in the form of three-dimensional point clouds and associated registered properties. However, managing the vast amounts of data generated by these sensors presents significant challenges. To ensure the effective use of multisensor data in the context of cultural heritage preservation, it is imperative that multisensor data fusion methods be designed in such a way as to facilitate informed decision-making by curators and stakeholders. We propose a novel approach to multisensor data fusion using multispectral voxels, which enable the application of deep learning algorithms as the self-organizing maps to identify and exploit the relationships between the different sensor data.. Our results indicate that this approach provides a comprehensive view of the building structure and its potential pathologies, and holds great promise for revolutionizing the study of historical buildings and their potential applications in the field of cultural heritage preservation