Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis

Aerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignmen...

Descripción completa

Detalles Bibliográficos
Autores: Mata Miquel, Cristian|||0000-0003-4768-5062, Ríos, Oriol, Pastor Ferrer, Elsa|||0000-0002-2985-3635, Planas Cuchi, Eulàlia|||0000-0002-7053-3959
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/191203
Acceso en línea:https://hdl.handle.net/2117/191203
https://dx.doi.org/10.3390/rs12030540
Access Level:acceso abierto
Palabra clave:Remote sensing
Wildland fire
Infrared imagery
Video stabilization
Image registration
Sensitivity analysis
Image similarity
Incendis
Teledetecció
Àrees temàtiques de la UPC::Enginyeria química
id ES_3c741568bb424b03cd37f7286b88e8ff
oai_identifier_str oai:upcommons.upc.edu:2117/191203
network_acronym_str ES
network_name_str España
repository_id_str
spelling Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysisMata Miquel, Cristian|||0000-0003-4768-5062Ríos, OriolPastor Ferrer, Elsa|||0000-0002-2985-3635Planas Cuchi, Eulàlia|||0000-0002-7053-3959Remote sensingWildland fireRemote sensingInfrared imageryVideo stabilizationImage registrationSensitivity analysisImage similarityIncendisTeledeteccióÀrees temàtiques de la UPC::Enginyeria químicaAerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignment is an essential operation for video stabilization. Misalignment can usually be estimated through image similarity, although image similarity metrics are also sensitive to other factors such as changes in the scene and lighting conditions. Therefore, this article presents a thorough analysis of image similarity measurement techniques useful for inter-frame registration in wildfire thermal video. Image similarity metrics most commonly and successfully employed in other fields were surveyed, adapted, benchmarked and compared. We investigated their response to different camera movement components as well as recording frequency and natural variations in fire, background and ambient conditions. The study was conducted in real video from six fire experimental scenarios, ranging from laboratory tests to large-scale controlled burns. Both Global and Local Sensitivity Analyses (GSA and LSA, respectively) were performed using state-of-the-art techniques. Based on the obtained results, two different similarity metrics are proposed to satisfy two different needs. A normalized version of Mutual Information is recommended as cost function during registration, whereas 2D correlation performed the best as quality control metric after registration.Peer ReviewedMultidisciplinary Digital Publishing Institute (MDPI)20202020-02-0120202020-06-19journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/191203https://dx.doi.org/10.3390/rs12030540reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Attribution 4.0 International (CC BY 4.0)http://creativecommons.org/licenses/by-nc-nd/3.0/es/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/1912032026-05-27T15:37:01Z
dc.title.none.fl_str_mv Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
title Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
spellingShingle Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
Mata Miquel, Cristian|||0000-0003-4768-5062
Remote sensing
Wildland fire
Remote sensing
Infrared imagery
Video stabilization
Image registration
Sensitivity analysis
Image similarity
Incendis
Teledetecció
Àrees temàtiques de la UPC::Enginyeria química
title_short Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
title_full Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
title_fullStr Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
title_full_unstemmed Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
title_sort Image similarity metrics suitable for infrared video stabilization during active wildfire monitoring: a comparative analysis
dc.creator.none.fl_str_mv Mata Miquel, Cristian|||0000-0003-4768-5062
Ríos, Oriol
Pastor Ferrer, Elsa|||0000-0002-2985-3635
Planas Cuchi, Eulàlia|||0000-0002-7053-3959
author Mata Miquel, Cristian|||0000-0003-4768-5062
author_facet Mata Miquel, Cristian|||0000-0003-4768-5062
Ríos, Oriol
Pastor Ferrer, Elsa|||0000-0002-2985-3635
Planas Cuchi, Eulàlia|||0000-0002-7053-3959
author_role author
author2 Ríos, Oriol
Pastor Ferrer, Elsa|||0000-0002-2985-3635
Planas Cuchi, Eulàlia|||0000-0002-7053-3959
author2_role author
author
author
dc.subject.none.fl_str_mv Remote sensing
Wildland fire
Remote sensing
Infrared imagery
Video stabilization
Image registration
Sensitivity analysis
Image similarity
Incendis
Teledetecció
Àrees temàtiques de la UPC::Enginyeria química
topic Remote sensing
Wildland fire
Remote sensing
Infrared imagery
Video stabilization
Image registration
Sensitivity analysis
Image similarity
Incendis
Teledetecció
Àrees temàtiques de la UPC::Enginyeria química
description Aerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignment is an essential operation for video stabilization. Misalignment can usually be estimated through image similarity, although image similarity metrics are also sensitive to other factors such as changes in the scene and lighting conditions. Therefore, this article presents a thorough analysis of image similarity measurement techniques useful for inter-frame registration in wildfire thermal video. Image similarity metrics most commonly and successfully employed in other fields were surveyed, adapted, benchmarked and compared. We investigated their response to different camera movement components as well as recording frequency and natural variations in fire, background and ambient conditions. The study was conducted in real video from six fire experimental scenarios, ranging from laboratory tests to large-scale controlled burns. Both Global and Local Sensitivity Analyses (GSA and LSA, respectively) were performed using state-of-the-art techniques. Based on the obtained results, two different similarity metrics are proposed to satisfy two different needs. A normalized version of Mutual Information is recommended as cost function during registration, whereas 2D correlation performed the best as quality control metric after registration.
publishDate 2020
dc.date.none.fl_str_mv 2020
2020-02-01
2020
2020-06-19
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/191203
https://dx.doi.org/10.3390/rs12030540
url https://hdl.handle.net/2117/191203
https://dx.doi.org/10.3390/rs12030540
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International (CC BY 4.0)
http://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International (CC BY 4.0)
http://creativecommons.org/licenses/by-nc-nd/3.0/es/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869406376608923648
score 15,301603

Similares en LA Referencia