Supplementary Eye Field Encodes Reward Prediction Error

Overview

Journal J Neurosci

Specialty Neurology

Date 2012 Mar 2

PMID 22378869

Citations 38

Authors

NaYoung So

Veit Stuphorn

Affiliations

Soon will be listed here.

Abstract

The outcomes of many decisions are uncertain and therefore need to be evaluated. We studied this evaluation process by recording neuronal activity in the supplementary eye field (SEF) during an oculomotor gambling task. While the monkeys awaited the outcome, SEF neurons represented attributes of the chosen option, namely, its expected value and the uncertainty of this value signal. After the gamble result was revealed, a number of neurons reflected the actual reward outcome. Other neurons evaluated the outcome by encoding the difference between the reward expectation represented during the delay period and the actual reward amount (i.e., the reward prediction error). Thus, SEF encodes not only reward prediction error but also all the components necessary for its computation: the expected and the actual outcome. This suggests that SEF might actively evaluate value-based decisions in the oculomotor domain, independent of other brain regions.

Citing Articles

Neurons of Macaque Frontal Eye Field Signal Reward-Related Surprise.

Shteyn M, Olson C J Neurosci. 2024; 44(38).

PMID: 39107059 PMC: 11411596. DOI: 10.1523/JNEUROSCI.0441-24.2024.

A dopamine mechanism for reward maximization.

Schultz W Proc Natl Acad Sci U S A. 2024; 121(20):e2316658121.

PMID: 38717856 PMC: 11098095. DOI: 10.1073/pnas.2316658121.

Involvement of the anterior insula and frontal operculum during wh-question comprehension of wh-in-situ Korean language.

Park H, Baik J, Park H PLoS One. 2024; 19(4):e0298740.

PMID: 38669282 PMC: 11051625. DOI: 10.1371/journal.pone.0298740.

Neural mechanisms for executive control of speed-accuracy trade-off.

Reppert T, Heitz R, Schall J Cell Rep. 2023; 42(11):113422.

PMID: 37950871 PMC: 10833473. DOI: 10.1016/j.celrep.2023.113422.

Reward prediction error in learning-related behaviors.

Deng Y, Song D, Ni J, Qing H, Quan Z Front Neurosci. 2023; 17:1171612.

PMID: 37662112 PMC: 10471312. DOI: 10.3389/fnins.2023.1171612.

References

Pearce J, Hall G . A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev. 1980; 87(6):532-52. View

Roesch M, Calu D, Esber G, Schoenbaum G . Neural correlates of variations in event processing during learning in basolateral amygdala. J Neurosci. 2010; 30(7):2464-71. PMC: 2838173. DOI: 10.1523/JNEUROSCI.5781-09.2010. View

HOLLAND , Gallagher . Amygdala circuitry in attentional and representational processes. Trends Cogn Sci. 1999; 3(2):65-73. DOI: 10.1016/s1364-6613(98)01271-6. View

McCoy A, Platt M . Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci. 2005; 8(9):1220-7. DOI: 10.1038/nn1523. View

So N, Stuphorn V . Supplementary eye field encodes option and action value for saccades with variable reward. J Neurophysiol. 2010; 104(5):2634-53. PMC: 4073903. DOI: 10.1152/jn.00430.2010. View

Lin S, Nicolelis M . Neuronal ensemble bursting in the basal forebrain encodes salience irrespective of valence. Neuron. 2008; 59(1):138-49. PMC: 2697387. DOI: 10.1016/j.neuron.2008.04.031. View

Tobler P, Fiorillo C, Schultz W . Adaptive coding of reward value by dopamine neurons. Science. 2005; 307(5715):1642-5. DOI: 10.1126/science.1105370. View

Sul J, Kim H, Huh N, Lee D, Jung M . Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron. 2010; 66(3):449-60. PMC: 2872629. DOI: 10.1016/j.neuron.2010.03.033. View

Holroyd C, Coles M . The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev. 2002; 109(4):679-709. DOI: 10.1037/0033-295X.109.4.679. View

10.

Ghashghaei H, Hilgetag C, Barbas H . Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage. 2006; 34(3):905-23. PMC: 2045074. DOI: 10.1016/j.neuroimage.2006.09.046. View

11.

Seo H, Lee D . Behavioral and neural changes after gains and losses of conditioned reinforcers. J Neurosci. 2009; 29(11):3627-41. PMC: 2750005. DOI: 10.1523/JNEUROSCI.4726-08.2009. View

12.

Schultz W, Dayan P, Montague P . A neural substrate of prediction and reward. Science. 1997; 275(5306):1593-9. DOI: 10.1126/science.275.5306.1593. View

13.

SAYER R, Friedlander M, Redman S . The time course and amplitude of EPSPs evoked at synapses between pairs of CA3/CA1 neurons in the hippocampal slice. J Neurosci. 1990; 10(3):826-36. PMC: 6570142. View

14.

Dayan P, Kakade S, Montague P . Learning and selective attention. Nat Neurosci. 2000; 3 Suppl:1218-23. DOI: 10.1038/81504. View

15.

Amador N, SCHLAG-REY M, Schlag J . Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. J Neurophysiol. 2000; 84(4):2166-70. DOI: 10.1152/jn.2000.84.4.2166. View

16.

Le Pelley M . The role of associative history in models of associative learning: a selective review and a hybrid model. Q J Exp Psychol B. 2004; 57(3):193-243. DOI: 10.1080/02724990344000141. View

17.

Schultz W . Predictive reward signal of dopamine neurons. J Neurophysiol. 1998; 80(1):1-27. DOI: 10.1152/jn.1998.80.1.1. View

18.

Tremblay L, Schultz W . Relative reward preference in primate orbitofrontal cortex. Nature. 1999; 398(6729):704-8. DOI: 10.1038/19525. View

19.

Stuphorn V, Brown J, Schall J . Role of supplementary eye field in saccade initiation: executive, not direct, control. J Neurophysiol. 2009; 103(2):801-16. PMC: 2822692. DOI: 10.1152/jn.00221.2009. View

20.

Nakamura K, Roesch M, Olson C . Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. J Neurophysiol. 2004; 93(2):884-908. DOI: 10.1152/jn.00305.2004. View