Pedestrian Detection at Day/Night Time with Visible and FIR Cameras

Despite all the significant advances in pedestrian detection brought by computer vision for driving assistance, it is still a challenging problem. One reason is the extremely varying lighting conditions under which such a detector should operate, namely day and nighttime. Recent research has shown t...

Descripción completa

Detalles Bibliográficos
Autores: González, Alejandro, Fang, Zhijie|||0000-0001-6184-8548, Socarras, Yainuvis, Serrat, Joan|||0000-0002-4554-199X, Vázquez, David, Xu, Jiaolong, López Peña, Antonio M.|||0000-0002-6979-5783
Tipo de recurso: artículo
Fecha de publicación:2016
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:254157
Acceso en línea:https://ddd.uab.cat/record/254157
https://dx.doi.org/urn:doi:10.3390/s16060820
Access Level:acceso abierto
Palabra clave:Far infrared
Day/nighttime
Pedestrian detection
id ES_4a245be170cb7d21df9afa249a26bc21
oai_identifier_str oai:ddd.uab.cat:254157
network_acronym_str ES
network_name_str España
repository_id_str
spelling Pedestrian Detection at Day/Night Time with Visible and FIR CamerasA ComparisonGonzález, AlejandroFang, Zhijie|||0000-0001-6184-8548Socarras, YainuvisSerrat, Joan|||0000-0002-4554-199XVázquez, DavidXu, JiaolongLópez Peña, Antonio M.|||0000-0002-6979-5783Far infraredDay/nighttimePedestrian detectionDespite all the significant advances in pedestrian detection brought by computer vision for driving assistance, it is still a challenging problem. One reason is the extremely varying lighting conditions under which such a detector should operate, namely day and nighttime. Recent research has shown that the combination of visible and non-visible imaging modalities may increase detection accuracy, where the infrared spectrum plays a critical role. The goal of this paper is to assess the accuracy gain of different pedestrian models (holistic, part-based, patch-based) when training with images in the far infrared spectrum. Specifically, we want to compare detection accuracy on test images recorded at day and nighttime if trained (and tested) using (a) plain color images; (b) just infrared images; and (c) both of them. In order to obtain results for the last item, we propose an early fusion approach to combine features from both modalities. We base the evaluation on a new dataset that we have built for this purpose as well as on the publicly available KAIST multispectral dataset. 22016-01-0120162016-01-01Articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://ddd.uab.cat/record/254157https://dx.doi.org/urn:doi:10.3390/s16060820reponame:Dipòsit Digital de Documents de la UABinstname:Universitat Autònoma de BarcelonaInglésengMinisterio de Economía y Competitividad https://doi.org/10.13039/501100003329 TRA2014-57088-C2-1-RAgència de Gestió d'Ajuts Universitaris i de Recerca https://doi.org/10.13039/501100003030 2014/SGR-1506open accesshttp://purl.org/coar/access_right/c_abf2Aquest document està subjecte a una llicència d'ús Creative Commons. Es permet la reproducció total o parcial, la distribució, la comunicació pública de l'obra i la creació d'obres derivades, fins i tot amb finalitats comercials, sempre i quan es reconegui l'autoria de l'obra original.https://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:ddd.uab.cat:2541572026-06-06T12:50:31Z
dc.title.none.fl_str_mv Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
A Comparison
title Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
spellingShingle Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
González, Alejandro
Far infrared
Day/nighttime
Pedestrian detection
title_short Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
title_full Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
title_fullStr Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
title_full_unstemmed Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
title_sort Pedestrian Detection at Day/Night Time with Visible and FIR Cameras
dc.creator.none.fl_str_mv González, Alejandro
Fang, Zhijie|||0000-0001-6184-8548
Socarras, Yainuvis
Serrat, Joan|||0000-0002-4554-199X
Vázquez, David
Xu, Jiaolong
López Peña, Antonio M.|||0000-0002-6979-5783
author González, Alejandro
author_facet González, Alejandro
Fang, Zhijie|||0000-0001-6184-8548
Socarras, Yainuvis
Serrat, Joan|||0000-0002-4554-199X
Vázquez, David
Xu, Jiaolong
López Peña, Antonio M.|||0000-0002-6979-5783
author_role author
author2 Fang, Zhijie|||0000-0001-6184-8548
Socarras, Yainuvis
Serrat, Joan|||0000-0002-4554-199X
Vázquez, David
Xu, Jiaolong
López Peña, Antonio M.|||0000-0002-6979-5783
author2_role author
author
author
author
author
author
dc.subject.none.fl_str_mv Far infrared
Day/nighttime
Pedestrian detection
topic Far infrared
Day/nighttime
Pedestrian detection
description Despite all the significant advances in pedestrian detection brought by computer vision for driving assistance, it is still a challenging problem. One reason is the extremely varying lighting conditions under which such a detector should operate, namely day and nighttime. Recent research has shown that the combination of visible and non-visible imaging modalities may increase detection accuracy, where the infrared spectrum plays a critical role. The goal of this paper is to assess the accuracy gain of different pedestrian models (holistic, part-based, patch-based) when training with images in the far infrared spectrum. Specifically, we want to compare detection accuracy on test images recorded at day and nighttime if trained (and tested) using (a) plain color images; (b) just infrared images; and (c) both of them. In order to obtain results for the last item, we propose an early fusion approach to combine features from both modalities. We base the evaluation on a new dataset that we have built for this purpose as well as on the publicly available KAIST multispectral dataset.
publishDate 2016
dc.date.none.fl_str_mv 2
2016-01-01
2016
2016-01-01
dc.type.none.fl_str_mv Article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://ddd.uab.cat/record/254157
https://dx.doi.org/urn:doi:10.3390/s16060820
url https://ddd.uab.cat/record/254157
https://dx.doi.org/urn:doi:10.3390/s16060820
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Ministerio de Economía y Competitividad https://doi.org/10.13039/501100003329 TRA2014-57088-C2-1-R
Agència de Gestió d'Ajuts Universitaris i de Recerca https://doi.org/10.13039/501100003030 2014/SGR-1506
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
https://creativecommons.org/licenses/by/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
https://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Dipòsit Digital de Documents de la UAB
instname:Universitat Autònoma de Barcelona
instname_str Universitat Autònoma de Barcelona
reponame_str Dipòsit Digital de Documents de la UAB
collection Dipòsit Digital de Documents de la UAB
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869407467552636928
score 15,300719

Similares en LA Referencia