Non-reward neural mechanisms in the orbitofrontal cortex

Single neurons in the primate orbitofrontal cortex respond when an expected reward is not obtained, and behaviour must change. The human lateral orbitofrontal cortex is activated when non-reward, or loss occurs. The neuronal computation of this negative reward prediction error is fundamental for the...

Descripción completa

Detalles Bibliográficos
Autores: Rolls, Edmund T, Deco, Gustavo
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2016
País:España
Institución:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/32529
Acceso en línea:http://hdl.handle.net/10230/32529
http://dx.doi.org/10.1016/j.cortex.2016.06.023
Access Level:acceso abierto
Palabra clave:Emotion
Reward
Non-reward
Reward prediction error
Orbitofrontal cortex
Attractor network
Depression
Impulsiveness
id ES_c83eae5cd03368163b8d0c24159eb9ba
oai_identifier_str oai:repositori.upf.edu:10230/32529
network_acronym_str ES
network_name_str España
repository_id_str
spelling Non-reward neural mechanisms in the orbitofrontal cortexRolls, Edmund TDeco, GustavoEmotionRewardNon-rewardReward prediction errorOrbitofrontal cortexAttractor networkDepressionImpulsivenessSingle neurons in the primate orbitofrontal cortex respond when an expected reward is not obtained, and behaviour must change. The human lateral orbitofrontal cortex is activated when non-reward, or loss occurs. The neuronal computation of this negative reward prediction error is fundamental for the emotional changes associated with non-reward, and with changing behaviour. Little is known about the neuronal mechanism. Here we propose a mechanism, which we formalize into a neuronal network model, which is simulated to enable the operation of the mechanism to be investigated. A single attractor network has a reward population (or pool) of neurons that is activated by expected reward, and maintain their firing until, after a time, synaptic depression reduces the firing rate in this neuronal population. If a reward outcome is not received, the decreasing firing in the reward neurons releases the inhibition implemented by inhibitory neurons, and this results in a second population of non-reward neurons to start and continue firing encouraged by the spiking-related noise in the network. If a reward outcome is received, this keeps the reward attractor active, and this through the inhibitory neurons prevents the non-reward attractor neurons from being activated. If an expected reward has been signalled, and the reward attractor neurons are active, their firing can be directly inhibited by a non-reward outcome, and the non-reward neurons become activated because the inhibition on them is released. The neuronal mechanisms in the orbitofrontal cortex for computing negative reward prediction error are important, for this system may be over-reactive in depression, under-reactive in impulsive behaviour, and may influence the dopaminergic ‘prediction error’ neurons.This research was supported by the Oxford Centre for Computational Neuroscience, Oxford, UK. GD was supported by the ERC Advanced Grant: DYSTRUCTURE (no. 295129), and by the Spanish Research Project SAF2010-16085.Elsevier20172016info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersionapplication/pdfapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/32529http://dx.doi.org/10.1016/j.cortex.2016.06.023reponame:Repositorio Digital de la UPFinstname:Universitat Pompeu FabraInglésCortex. 2016;83: 27-38info:eu-repo/grantAgreement/EC/FP7/295129info:eu-repo/grantAgreement/ES/3PN/SAF2010-16085© Elsevier http://dx.doi.org/10.1016/j.cortex.2016.06.023info:eu-repo/semantics/openAccessoai:repositori.upf.edu:10230/325292026-06-12T07:21:37Z
dc.title.none.fl_str_mv Non-reward neural mechanisms in the orbitofrontal cortex
title Non-reward neural mechanisms in the orbitofrontal cortex
spellingShingle Non-reward neural mechanisms in the orbitofrontal cortex
Rolls, Edmund T
Emotion
Reward
Non-reward
Reward prediction error
Orbitofrontal cortex
Attractor network
Depression
Impulsiveness
title_short Non-reward neural mechanisms in the orbitofrontal cortex
title_full Non-reward neural mechanisms in the orbitofrontal cortex
title_fullStr Non-reward neural mechanisms in the orbitofrontal cortex
title_full_unstemmed Non-reward neural mechanisms in the orbitofrontal cortex
title_sort Non-reward neural mechanisms in the orbitofrontal cortex
dc.creator.none.fl_str_mv Rolls, Edmund T
Deco, Gustavo
author Rolls, Edmund T
author_facet Rolls, Edmund T
Deco, Gustavo
author_role author
author2 Deco, Gustavo
author2_role author
dc.subject.none.fl_str_mv Emotion
Reward
Non-reward
Reward prediction error
Orbitofrontal cortex
Attractor network
Depression
Impulsiveness
topic Emotion
Reward
Non-reward
Reward prediction error
Orbitofrontal cortex
Attractor network
Depression
Impulsiveness
description Single neurons in the primate orbitofrontal cortex respond when an expected reward is not obtained, and behaviour must change. The human lateral orbitofrontal cortex is activated when non-reward, or loss occurs. The neuronal computation of this negative reward prediction error is fundamental for the emotional changes associated with non-reward, and with changing behaviour. Little is known about the neuronal mechanism. Here we propose a mechanism, which we formalize into a neuronal network model, which is simulated to enable the operation of the mechanism to be investigated. A single attractor network has a reward population (or pool) of neurons that is activated by expected reward, and maintain their firing until, after a time, synaptic depression reduces the firing rate in this neuronal population. If a reward outcome is not received, the decreasing firing in the reward neurons releases the inhibition implemented by inhibitory neurons, and this results in a second population of non-reward neurons to start and continue firing encouraged by the spiking-related noise in the network. If a reward outcome is received, this keeps the reward attractor active, and this through the inhibitory neurons prevents the non-reward attractor neurons from being activated. If an expected reward has been signalled, and the reward attractor neurons are active, their firing can be directly inhibited by a non-reward outcome, and the non-reward neurons become activated because the inhibition on them is released. The neuronal mechanisms in the orbitofrontal cortex for computing negative reward prediction error are important, for this system may be over-reactive in depression, under-reactive in impulsive behaviour, and may influence the dopaminergic ‘prediction error’ neurons.
publishDate 2016
dc.date.none.fl_str_mv 2016
2017
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/32529
http://dx.doi.org/10.1016/j.cortex.2016.06.023
url http://hdl.handle.net/10230/32529
http://dx.doi.org/10.1016/j.cortex.2016.06.023
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Cortex. 2016;83: 27-38
info:eu-repo/grantAgreement/EC/FP7/295129
info:eu-repo/grantAgreement/ES/3PN/SAF2010-16085
dc.rights.none.fl_str_mv © Elsevier http://dx.doi.org/10.1016/j.cortex.2016.06.023
info:eu-repo/semantics/openAccess
rights_invalid_str_mv © Elsevier http://dx.doi.org/10.1016/j.cortex.2016.06.023
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:Repositorio Digital de la UPF
instname:Universitat Pompeu Fabra
instname_str Universitat Pompeu Fabra
reponame_str Repositorio Digital de la UPF
collection Repositorio Digital de la UPF
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869419269093064704
score 15,198674