Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis

Aerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignmen...

Full description

Bibliographic Details
Authors: Valero, Mario M., Verstockt, S., Mata, C., Jimenez, D., Queen, Ll., Ríos, O., Pastor, E., Planas, E.
Format: article
Status:Published version
Publication Date:2020
Country:España
Institution:Fundació Sant Joan de Déu
Repository:r-FSJD. Repositorio Institucional de Producción Científica de la Fundació Sant Joan de Déu
OAI Identifier:oai:fsjd.fundanetsuite.com:p20990
Online Access:https://fsjd.fundanetsuite.com/Publicaciones/ProdCientif/PublicacionFrw.aspx?id=20990
Access Level:Open access
Keyword:wildland fire
remote sensing
infrared imagery
video stabilization
image registration
sensitivity analysis
image similarity
id ES_d53cfd5f03ac95ae1f8f41bfb01a89db
oai_identifier_str oai:fsjd.fundanetsuite.com:p20990
network_acronym_str ES
network_name_str España
repository_id_str
spelling Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative AnalysisValero, Mario M.Verstockt, S.Mata, C.Jimenez, D.Queen, Ll.Ríos, O.Pastor, E.Planas, E.wildland fireremote sensinginfrared imageryvideo stabilizationimage registrationsensitivity analysisimage similarityAerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignment is an essential operation for video stabilization. Misalignment can usually be estimated through image similarity, although image similarity metrics are also sensitive to other factors such as changes in the scene and lighting conditions. Therefore, this article presents a thorough analysis of image similarity measurement techniques useful for inter-frame registration in wildfire thermal video. Image similarity metrics most commonly and successfully employed in other fields were surveyed, adapted, benchmarked and compared. We investigated their response to different camera movement components as well as recording frequency and natural variations in fire, background and ambient conditions. The study was conducted in real video from six fire experimental scenarios, ranging from laboratory tests to large-scale controlled burns. Both Global and Local Sensitivity Analyses (GSA and LSA, respectively) were performed using state-of-the-art techniques. Based on the obtained results, two different similarity metrics are proposed to satisfy two different needs. A normalized version of Mutual Information is recommended as cost function during registration, whereas 2D correlation performed the best as quality control metric after registration. These results provide a sound basis for image alignment measurement and open the door to further developments in image registration, motion estimation and video stabilization for aerial monitoring of active wildland fires.MDPI2020info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttps://fsjd.fundanetsuite.com/Publicaciones/ProdCientif/PublicacionFrw.aspx?id=20990Remote SensingISSN: 20724292reponame:r-FSJD. Repositorio Institucional de Producción Científica de la Fundació Sant Joan de Déuinstname:Fundació Sant Joan de DéuInglésinfo:eu-repo/semantics/openAccessoai:fsjd.fundanetsuite.com:p209902026-05-27T12:37:41Z
dc.title.none.fl_str_mv Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
title Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
spellingShingle Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
Valero, Mario M.
wildland fire
remote sensing
infrared imagery
video stabilization
image registration
sensitivity analysis
image similarity
title_short Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
title_full Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
title_fullStr Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
title_full_unstemmed Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
title_sort Image Similarity Metrics Suitable for Infrared Video Stabilization during Active Wildfire Monitoring: A Comparative Analysis
dc.creator.none.fl_str_mv Valero, Mario M.
Verstockt, S.
Mata, C.
Jimenez, D.
Queen, Ll.
Ríos, O.
Pastor, E.
Planas, E.
author Valero, Mario M.
author_facet Valero, Mario M.
Verstockt, S.
Mata, C.
Jimenez, D.
Queen, Ll.
Ríos, O.
Pastor, E.
Planas, E.
author_role author
author2 Verstockt, S.
Mata, C.
Jimenez, D.
Queen, Ll.
Ríos, O.
Pastor, E.
Planas, E.
author2_role author
author
author
author
author
author
author
dc.subject.none.fl_str_mv wildland fire
remote sensing
infrared imagery
video stabilization
image registration
sensitivity analysis
image similarity
topic wildland fire
remote sensing
infrared imagery
video stabilization
image registration
sensitivity analysis
image similarity
description Aerial Thermal Infrared (TIR) imagery has demonstrated tremendous potential to monitor active forest fires and acquire detailed information about fire behavior. However, aerial video is usually unstable and requires inter-frame registration before further processing. Measurement of image misalignment is an essential operation for video stabilization. Misalignment can usually be estimated through image similarity, although image similarity metrics are also sensitive to other factors such as changes in the scene and lighting conditions. Therefore, this article presents a thorough analysis of image similarity measurement techniques useful for inter-frame registration in wildfire thermal video. Image similarity metrics most commonly and successfully employed in other fields were surveyed, adapted, benchmarked and compared. We investigated their response to different camera movement components as well as recording frequency and natural variations in fire, background and ambient conditions. The study was conducted in real video from six fire experimental scenarios, ranging from laboratory tests to large-scale controlled burns. Both Global and Local Sensitivity Analyses (GSA and LSA, respectively) were performed using state-of-the-art techniques. Based on the obtained results, two different similarity metrics are proposed to satisfy two different needs. A normalized version of Mutual Information is recommended as cost function during registration, whereas 2D correlation performed the best as quality control metric after registration. These results provide a sound basis for image alignment measurement and open the door to further developments in image registration, motion estimation and video stabilization for aerial monitoring of active wildland fires.
publishDate 2020
dc.date.none.fl_str_mv 2020
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv https://fsjd.fundanetsuite.com/Publicaciones/ProdCientif/PublicacionFrw.aspx?id=20990
url https://fsjd.fundanetsuite.com/Publicaciones/ProdCientif/PublicacionFrw.aspx?id=20990
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv Remote Sensing
ISSN: 20724292
reponame:r-FSJD. Repositorio Institucional de Producción Científica de la Fundació Sant Joan de Déu
instname:Fundació Sant Joan de Déu
instname_str Fundació Sant Joan de Déu
reponame_str r-FSJD. Repositorio Institucional de Producción Científica de la Fundació Sant Joan de Déu
collection r-FSJD. Repositorio Institucional de Producción Científica de la Fundació Sant Joan de Déu
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869420662019325952
score 15.811543

Similar Items