Expectancy-related Changes in Firing of Dopamine Neurons Depend on Orbitofrontal Cortex

Overview

Journal Nat Neurosci

Date 2011 Nov 1

PMID 22037501

Citations 155

Authors

Yuji K Takahashi

Matthew R Roesch

Robert C Wilson

Kathy Toreson

Patricio ODonnell

Yael Niv

Geoffrey Schoenbaum

Affiliations

Soon will be listed here.

Abstract

The orbitofrontal cortex has been hypothesized to carry information regarding the value of expected rewards. Such information is essential for associative learning, which relies on comparisons between expected and obtained reward for generating instructive error signals. These error signals are thought to be conveyed by dopamine neurons. To test whether orbitofrontal cortex contributes to these error signals, we recorded from dopamine neurons in orbitofrontal-lesioned rats performing a reward learning task. Lesions caused marked changes in dopaminergic error signaling. However, the effect of lesions was not consistent with a simple loss of information regarding expected value. Instead, without orbitofrontal input, dopaminergic error signals failed to reflect internal information about the impending response that distinguished externally similar states leading to differently valued future rewards. These results are consistent with current conceptualizations of orbitofrontal cortex as supporting model-based behavior and suggest an unexpected role for this information in dopaminergic error signaling.

Citing Articles

Neuromodulation of Dopamine D2 Receptors Alters Orbitofrontal Neuronal Activity and Reduces Risk-Prone Behavior in Male Rats with Inflammatory Pain.

Dourado M, Cardoso-Cruz H, Monteiro C, Galhardo V Mol Neurobiol. 2025; .

PMID: 39985709 DOI: 10.1007/s12035-025-04781-0.

Dopaminergic responses to identity prediction errors depend differently on the orbitofrontal cortex and hippocampus.

Takahashi Y, Zhang Z, Kahnt T, Schoenbaum G bioRxiv. 2025; .

PMID: 39763911 PMC: 11702580. DOI: 10.1101/2024.12.11.628003.

Aberrant encoding of event saliency in the orbitofrontal cortex following loss of the psychiatric-associated circular RNA, circHomer1.

Zimmerman A, Weick J, Papageorgiou G, Mellios N, Brigman J Transl Psychiatry. 2024; 14(1):480.

PMID: 39609379 PMC: 11604931. DOI: 10.1038/s41398-024-03188-0.

Modeling impaired insight after drug use in rodents.

Panayi M, Schoenbaum G Behav Neurosci. 2024; 138(4):291-300.

PMID: 39250296 PMC: 11874615. DOI: 10.1037/bne0000606.

Distributed midbrain responses signal the content of positive identity prediction errors.

Howard J, Edmonds D, Schoenbaum G, Kahnt T Curr Biol. 2024; 34(18):4240-4247.e4.

PMID: 39197457 PMC: 11421979. DOI: 10.1016/j.cub.2024.07.105.

References

Schoenbaum G, Roesch M, Stalnaker T, Takahashi Y . A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci. 2009; 10(12):885-92. PMC: 2835299. DOI: 10.1038/nrn2753. View

Voorn P, Vanderschuren L, Groenewegen H, Robbins T, Pennartz C . Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 2004; 27(8):468-74. DOI: 10.1016/j.tins.2004.06.006. View

Ramus S, Eichenbaum H . Neural correlates of olfactory recognition memory in the rat orbitofrontal cortex. J Neurosci. 2000; 20(21):8199-208. PMC: 6772715. View

Roesch M, Taylor A, Schoenbaum G . Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron. 2006; 51(4):509-20. PMC: 2561990. DOI: 10.1016/j.neuron.2006.06.027. View

Bromberg-Martin E, Matsumoto M, Hong S, Hikosaka O . A pallidus-habenula-dopamine pathway signals inferred stimulus values. J Neurophysiol. 2010; 104(2):1068-76. PMC: 2934919. DOI: 10.1152/jn.00158.2010. View

Tsuchida A, Doll B, Fellows L . Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J Neurosci. 2010; 30(50):16868-75. PMC: 6634931. DOI: 10.1523/JNEUROSCI.1958-10.2010. View

van Duuren E, van der Plasse G, Lankelma J, Joosten R, Feenstra M, Pennartz C . Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci. 2009; 29(28):8965-76. PMC: 6665423. DOI: 10.1523/JNEUROSCI.0005-09.2009. View

Abe H, Lee D . Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron. 2011; 70(4):731-41. PMC: 3104017. DOI: 10.1016/j.neuron.2011.03.026. View

Daw N, Gershman S, Seymour B, Dayan P, Dolan R . Model-based influences on humans' choices and striatal prediction errors. Neuron. 2011; 69(6):1204-15. PMC: 3077926. DOI: 10.1016/j.neuron.2011.02.027. View

10.

Schultz W, Dayan P, Montague P . A neural substrate of prediction and reward. Science. 1997; 275(5306):1593-9. DOI: 10.1126/science.275.5306.1593. View

11.

Burke K, Franz T, Miller D, Schoenbaum G . The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature. 2008; 454(7202):340-4. PMC: 2727745. DOI: 10.1038/nature06993. View

12.

Pickens C, Saddoris M, Setlow B, Gallagher M, Holland P, Schoenbaum G . Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci. 2003; 23(35):11078-84. PMC: 6741041. View

13.

Lodge D . The medial prefrontal and orbitofrontal cortices differentially regulate dopamine system function. Neuropsychopharmacology. 2011; 36(6):1227-36. PMC: 3079406. DOI: 10.1038/npp.2011.7. View

14.

Gershman S, Blei D, Niv Y . Context, learning, and extinction. Psychol Rev. 2010; 117(1):197-209. DOI: 10.1037/a0017808. View

15.

Gottfried J, ODoherty J, Dolan R . Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science. 2003; 301(5636):1104-7. DOI: 10.1126/science.1087919. View

16.

Pearce J, Hall G . A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev. 1980; 87(6):532-52. View

17.

Fellows L, Farah M . Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain. 2003; 126(Pt 8):1830-7. DOI: 10.1093/brain/awg180. View

18.

ODoherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan R . Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science. 2004; 304(5669):452-4. DOI: 10.1126/science.1094285. View

19.

van Duuren E, Lankelma J, Pennartz C . Population coding of reward magnitude in the orbitofrontal cortex of the rat. J Neurosci. 2008; 28(34):8590-603. PMC: 6671050. DOI: 10.1523/JNEUROSCI.5549-07.2008. View

20.

Vazquez-Borsetti P, Cortes R, Artigas F . Pyramidal neurons in rat prefrontal cortex projecting to ventral tegmental area and dorsal raphe nucleus express 5-HT2A receptors. Cereb Cortex. 2008; 19(7):1678-86. PMC: 2693622. DOI: 10.1093/cercor/bhn204. View