A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration

This paper presents the design and implementation of a 128 × 128 electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. P...

Descripción completa

Detalles Bibliográficos
Autores: Faramarzi, Farnaz, Linares Barranco, Bernabé, Serrano Gotarredona, María Teresa
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/168921
Acceso en línea:https://hdl.handle.net/11441/168921
https://doi.org/10.1109/ACCESS.2024.3519035
Access Level:acceso abierto
Palabra clave:Foveated dynamic vision sensor
Pixel grouping
Macro-pixel
Foveated vision
Multi-fovea
id ES_eb7a76b89cb11a2f1e188073cdd008bb
oai_identifier_str oai:idus.us.es:11441/168921
network_acronym_str ES
network_name_str España
repository_id_str
spelling A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution ReconfigurationFaramarzi, FarnazLinares Barranco, BernabéSerrano Gotarredona, María TeresaFoveated dynamic vision sensorPixel groupingMacro-pixelFoveated visionMulti-foveaThis paper presents the design and implementation of a 128 × 128 electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both highresolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of 3.66 μs and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7mWat 100 Keps when configured in low-resolution mode with a 2 × 2 pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical.Institute of Electrical and Electronics EngineersArquitectura y Tecnología de ComputadoresCHIST-ERAEuropean Union (UE)Junta de AndalucíaMinisterio de Ciencia, Innovación y Universidades (MICIU). EspañaEuropean Commission (EC). Fondo Europeo de Desarrollo Regional (FEDER)2024info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfapplication/pdfhttps://hdl.handle.net/11441/168921https://doi.org/10.1109/ACCESS.2024.3519035reponame:idUS. Depósito de Investigación de la Universidad de Sevillainstname:Universidad de Sevilla (US)InglésIEEE Access, 12, 192656-192671.PCI2019-111826-2EU HE 101070679PROYEXCEL_00060PDC2023-145841-C31PID2019-105556GB-C31https://ieeexplore.ieee.org/document/10804122info:eu-repo/semantics/openAccessoai:idus.us.es:11441/1689212026-06-17T12:51:07Z
dc.title.none.fl_str_mv A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
title A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
spellingShingle A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
Faramarzi, Farnaz
Foveated dynamic vision sensor
Pixel grouping
Macro-pixel
Foveated vision
Multi-fovea
title_short A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
title_full A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
title_fullStr A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
title_full_unstemmed A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
title_sort A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
dc.creator.none.fl_str_mv Faramarzi, Farnaz
Linares Barranco, Bernabé
Serrano Gotarredona, María Teresa
author Faramarzi, Farnaz
author_facet Faramarzi, Farnaz
Linares Barranco, Bernabé
Serrano Gotarredona, María Teresa
author_role author
author2 Linares Barranco, Bernabé
Serrano Gotarredona, María Teresa
author2_role author
author
dc.contributor.none.fl_str_mv Arquitectura y Tecnología de Computadores
CHIST-ERA
European Union (UE)
Junta de Andalucía
Ministerio de Ciencia, Innovación y Universidades (MICIU). España
European Commission (EC). Fondo Europeo de Desarrollo Regional (FEDER)
dc.subject.none.fl_str_mv Foveated dynamic vision sensor
Pixel grouping
Macro-pixel
Foveated vision
Multi-fovea
topic Foveated dynamic vision sensor
Pixel grouping
Macro-pixel
Foveated vision
Multi-fovea
description This paper presents the design and implementation of a 128 × 128 electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both highresolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of 3.66 μs and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7mWat 100 Keps when configured in low-resolution mode with a 2 × 2 pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical.
publishDate 2024
dc.date.none.fl_str_mv 2024
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv https://hdl.handle.net/11441/168921
https://doi.org/10.1109/ACCESS.2024.3519035
url https://hdl.handle.net/11441/168921
https://doi.org/10.1109/ACCESS.2024.3519035
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv IEEE Access, 12, 192656-192671.
PCI2019-111826-2
EU HE 101070679
PROYEXCEL_00060
PDC2023-145841-C31
PID2019-105556GB-C31
https://ieeexplore.ieee.org/document/10804122
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
dc.source.none.fl_str_mv reponame:idUS. Depósito de Investigación de la Universidad de Sevilla
instname:Universidad de Sevilla (US)
instname_str Universidad de Sevilla (US)
reponame_str idUS. Depósito de Investigación de la Universidad de Sevilla
collection idUS. Depósito de Investigación de la Universidad de Sevilla
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869423231404867584
score 15.812429

Similares en LA Referencia