Integrating Visual Perception With Decision Making in Neuromorphic Fault-Tolerant Quadruplet-Spike Learning Framework

The brain possesses the remarkable ability to seamlessly integrate perception with decision making within a dynamically changing environment in a fault-tolerant, end-to-end manner. This extraordinary capability offers a compelling solution for brain-inspired intelligence, replete with the advantages...

Descripción completa

Detalles Bibliográficos
Autores: Yang, Shuangming, Wang, Haowen, Pang, Yanwei, Jin, Yaochu, Linares-Barranco, Bernabé
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2023
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/390736
Acceso en línea:http://hdl.handle.net/10261/390736
https://api.elsevier.com/content/abstract/scopus_id/85177085847
Access Level:acceso abierto
Palabra clave:Decision making
Fault tolerant
Neuromorphic computing
Spike-timing-dependent plasticity (STDP)
Spiking neural network (SNN)
Descripción
Sumario:The brain possesses the remarkable ability to seamlessly integrate perception with decision making within a dynamically changing environment in a fault-tolerant, end-to-end manner. This extraordinary capability offers a compelling solution for brain-inspired intelligence, replete with the advantages of end-to-end decision making: robustness, high accuracy, real-time responsiveness, autonomous intelligence, and a high degree of biological plausibility. Neuromorphic computing stands as a promising avenue for brain-inspired intelligence through the harmonious co-design of algorithms and hardware, aimed at unlocking full potential. This article introduces a comprehensive neuromorphic computing framework for end-to-end intelligence. It introduces the quadruplet spike-timing-dependent plasticity, which serves as a cornerstone for perceptual to decision-making tasks. A fault-tolerant neuromorphic routing strategy is presented to fortify the framework's robustness. Empirical results underscore its impressive attributes with high accuracy, robustness, fault tolerance, and minimal computational latency when orchestrating end-to-end decision-making alongside visual perception. This study marks a pioneering effort in unified, fault-tolerant neuromorphic framework engineered for brain-inspired end-to-end intelligent tasks, merging visual perception with adaptive decision making. Such an endeavor is profoundly meaningful, as it propels the development of artificial general intelligence, holding vast implications for the field's advancement.