Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)

In stereo-vision processing, the image-matching step is essential for results, although it involves a very high computational cost. Moreover, the more information is processed, the more time is spent by the matching algorithm, and the more ine cient it is. Spike-based processing is a relatively new...

Descripción completa

Detalles Bibliográficos
Autores: Domínguez Morales, Manuel Jesús, Domínguez Morales, Juan Pedro, Jiménez Fernández, Ángel Francisco, Linares Barranco, Alejandro, Jiménez Moreno, Gabriel
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2019
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/88715
Acceso en línea:https://hdl.handle.net/11441/88715
https://doi.org/10.3390/electronics8040410
Access Level:acceso abierto
Palabra clave:Address-event-representation
Spike
Neuromorphic engineering
Stereo vision
Epipolar geometry
Dynamic vision sensors
Retina
FPGA
id ES_be9abea3aee591cd79efd2fc499bf35b
oai_identifier_str oai:idus.us.es:11441/88715
network_acronym_str ES
network_name_str España
repository_id_str
spelling Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)Domínguez Morales, Manuel JesúsDomínguez Morales, Juan PedroJiménez Fernández, Ángel FranciscoLinares Barranco, AlejandroJiménez Moreno, GabrielAddress-event-representationSpikeNeuromorphic engineeringStereo visionEpipolar geometryDynamic vision sensorsRetinaFPGAIn stereo-vision processing, the image-matching step is essential for results, although it involves a very high computational cost. Moreover, the more information is processed, the more time is spent by the matching algorithm, and the more ine cient it is. Spike-based processing is a relatively new approach that implements processing methods by manipulating spikes one by one at the time they are transmitted, like a human brain. The mammal nervous system can solve much more complex problems, such as visual recognition by manipulating neuron spikes. The spike-based philosophy for visual information processing based on the neuro-inspired address-event-representation (AER) is currently achieving very high performance. The aim of this work was to study the viability of a matching mechanism in stereo-vision systems, using AER codification and its implementation in a field-programmable gate array (FPGA). Some studies have been done before in an AER system with monitored data using a computer; however, this kind of mechanism has not been implemented directly on hardware. To this end, an epipolar geometry basis applied to AER systems was studied and implemented, with other restrictions, in order to achieve good results in a real-time scenario. The results and conclusions are shown, and the viability of its implementation is proven.Ministerio de Economía y Competitividad TEC2016-77785-PMDPIArquitectura y Tecnología de ComputadoresTEP-108: Robótica y Tecnología de Computadores Aplicada a la Rehabilitación2019info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfapplication/pdfhttps://hdl.handle.net/11441/88715https://doi.org/10.3390/electronics8040410reponame:idUS. Depósito de Investigación de la Universidad de Sevillainstname:Universidad de Sevilla (US)InglésElectronics, 8 (4-410)TEC2016-77785-Phttps://www.mdpi.com/2079-9292/8/4/410info:eu-repo/semantics/openAccessoai:idus.us.es:11441/887152026-06-17T12:51:07Z
dc.title.none.fl_str_mv Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
title Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
spellingShingle Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
Domínguez Morales, Manuel Jesús
Address-event-representation
Spike
Neuromorphic engineering
Stereo vision
Epipolar geometry
Dynamic vision sensors
Retina
FPGA
title_short Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
title_full Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
title_fullStr Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
title_full_unstemmed Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
title_sort Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)
dc.creator.none.fl_str_mv Domínguez Morales, Manuel Jesús
Domínguez Morales, Juan Pedro
Jiménez Fernández, Ángel Francisco
Linares Barranco, Alejandro
Jiménez Moreno, Gabriel
author Domínguez Morales, Manuel Jesús
author_facet Domínguez Morales, Manuel Jesús
Domínguez Morales, Juan Pedro
Jiménez Fernández, Ángel Francisco
Linares Barranco, Alejandro
Jiménez Moreno, Gabriel
author_role author
author2 Domínguez Morales, Juan Pedro
Jiménez Fernández, Ángel Francisco
Linares Barranco, Alejandro
Jiménez Moreno, Gabriel
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Arquitectura y Tecnología de Computadores
TEP-108: Robótica y Tecnología de Computadores Aplicada a la Rehabilitación
dc.subject.none.fl_str_mv Address-event-representation
Spike
Neuromorphic engineering
Stereo vision
Epipolar geometry
Dynamic vision sensors
Retina
FPGA
topic Address-event-representation
Spike
Neuromorphic engineering
Stereo vision
Epipolar geometry
Dynamic vision sensors
Retina
FPGA
description In stereo-vision processing, the image-matching step is essential for results, although it involves a very high computational cost. Moreover, the more information is processed, the more time is spent by the matching algorithm, and the more ine cient it is. Spike-based processing is a relatively new approach that implements processing methods by manipulating spikes one by one at the time they are transmitted, like a human brain. The mammal nervous system can solve much more complex problems, such as visual recognition by manipulating neuron spikes. The spike-based philosophy for visual information processing based on the neuro-inspired address-event-representation (AER) is currently achieving very high performance. The aim of this work was to study the viability of a matching mechanism in stereo-vision systems, using AER codification and its implementation in a field-programmable gate array (FPGA). Some studies have been done before in an AER system with monitored data using a computer; however, this kind of mechanism has not been implemented directly on hardware. To this end, an epipolar geometry basis applied to AER systems was studied and implemented, with other restrictions, in order to achieve good results in a real-time scenario. The results and conclusions are shown, and the viability of its implementation is proven.
publishDate 2019
dc.date.none.fl_str_mv 2019
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv https://hdl.handle.net/11441/88715
https://doi.org/10.3390/electronics8040410
url https://hdl.handle.net/11441/88715
https://doi.org/10.3390/electronics8040410
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Electronics, 8 (4-410)
TEC2016-77785-P
https://www.mdpi.com/2079-9292/8/4/410
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:idUS. Depósito de Investigación de la Universidad de Sevilla
instname:Universidad de Sevilla (US)
instname_str Universidad de Sevilla (US)
reponame_str idUS. Depósito de Investigación de la Universidad de Sevilla
collection idUS. Depósito de Investigación de la Universidad de Sevilla
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869418299387805696
score 15,300724

Similares en LA Referencia