Cross-species Studies on Orbitofrontal Control of Inference-based Behavior

Overview

Journal Behav Neurosci

Publisher American Psychological Association

Specialty Psychology

Date 2021 Jun 1

PMID 34060869

Citations 6

Authors

Thorsten Kahnt

Geoffrey Schoenbaum

Affiliations

Soon will be listed here.

Abstract

Many decisions are guided by expectations about their outcomes. These expectations can arise from two fundamentally different sources: from direct experience with outcomes and the events and actions that precede them or from mental simulations and inferences when direct experience is missing. Here we discuss four elegant tasks from animal learning theory (devaluation, sensory preconditioning, Pavlovian-to-instrumental transfer, and Pavlovian overexpectation) and how they can be used to isolate behavior that is based on such mental simulations from behavior that can be based solely on experience. We then review findings from studies in rodents, nonhuman primates, and humans that use these tasks in combination with neural recording and loss-of-function experiments to understand the role of the orbitofrontal cortex (OFC) in outcome inference. The results of these studies show that activity in the OFC is correlated with inferred outcome expectations and that an intact OFC is necessary for inference-based behavior and learning. In summary, these findings provide converging cross-species support for the idea that the OFC is critical for behavior that is based on inferred outcomes, whereas it is not required when expectations can be based on direct experience alone. This conclusion may have important implications for our understanding of the role of OFC in psychiatric disorders and how we may be able to treat them. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Citing Articles

Individual differences in intolerance of uncertainty is primarily linked to the structure of inferior frontal regions.

Carlson 2nd K, Smolker H, Smith L, Synder H, Snyder H, Hankin B Cogn Affect Behav Neurosci. 2025; .

PMID: 39870976 DOI: 10.3758/s13415-024-01262-0.

Modeling impaired insight after drug use in rodents.

Panayi M, Schoenbaum G Behav Neurosci. 2024; 138(4):291-300.

PMID: 39250296 PMC: 11874615. DOI: 10.1037/bne0000606.

Distinct roles of monkey OFC-subcortical pathways in adaptive behavior.

Oyama K, Majima K, Nagai Y, Hori Y, Hirabayashi T, Eldridge M Nat Commun. 2024; 15(1):6487.

PMID: 39198415 PMC: 11358305. DOI: 10.1038/s41467-024-50505-8.

Distinct roles of monkey OFC-subcortical pathways in adaptive behavior.

Oyama K, Majima K, Nagai Y, Hori Y, Hirabayashi T, Eldridge M bioRxiv. 2023; .

PMID: 38076986 PMC: 10705585. DOI: 10.1101/2023.11.17.567492.

The cognitive (lateral) hypothalamus.

Sharpe M Trends Cogn Sci. 2023; 28(1):18-29.

PMID: 37758590 PMC: 10841673. DOI: 10.1016/j.tics.2023.08.019.

References

Lucantonio F, Kambhampati S, Haney R, Atalayer D, Rowland N, Shaham Y . Effects of prior cocaine versus morphine or heroin self-administration on extinction learning driven by overexpectation versus omission of reward. Biol Psychiatry. 2015; 77(10):912-20. PMC: 4417051. DOI: 10.1016/j.biopsych.2014.11.017. View

Wimmer G, Shohamy D . Preference by association: how memory mechanisms in the hippocampus bias decisions. Science. 2012; 338(6104):270-3. DOI: 10.1126/science.1223252. View

Collins D, Shanks D . Summation in causal learning: elemental processing or configural generalization?. Q J Exp Psychol (Hove). 2006; 59(9):1524-34. DOI: 10.1080/17470210600639389. View

Talmi D, Seymour B, Dayan P, Dolan R . Human pavlovian-instrumental transfer. J Neurosci. 2008; 28(2):360-8. PMC: 2636904. DOI: 10.1523/JNEUROSCI.4028-07.2008. View

Rangel A, Camerer C, Montague P . A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci. 2008; 9(7):545-56. PMC: 4332708. DOI: 10.1038/nrn2357. View

Bradfield L, Dezfouli A, van Holstein M, Chieng B, Balleine B . Medial Orbitofrontal Cortex Mediates Outcome Retrieval in Partially Observable Task Situations. Neuron. 2015; 88(6):1268-1280. DOI: 10.1016/j.neuron.2015.10.044. View

Gottfried J, ODoherty J, Dolan R . Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science. 2003; 301(5636):1104-7. DOI: 10.1126/science.1087919. View

Lucantonio F, Takahashi Y, Hoffman A, Chang C, Bali-Chaudhary S, Shaham Y . Orbitofrontal activation restores insight lost after cocaine use. Nat Neurosci. 2014; 17(8):1092-9. PMC: 4120653. DOI: 10.1038/nn.3763. View

Howard J, Kahnt T . Identity prediction errors in the human midbrain update reward-identity expectations in the orbitofrontal cortex. Nat Commun. 2018; 9(1):1611. PMC: 5913228. DOI: 10.1038/s41467-018-04055-5. View

10.

Takahashi Y, Stalnaker T, Roesch M, Schoenbaum G . Effects of inference on dopaminergic prediction errors depend on orbitofrontal processing. Behav Neurosci. 2017; 131(2):127-134. PMC: 5356489. DOI: 10.1037/bne0000192. View

11.

Murray E, Moylan E, Saleem K, Basile B, Turchi J . Specialized areas for value updating and goal selection in the primate orbitofrontal cortex. Elife. 2015; 4. PMC: 4739757. DOI: 10.7554/eLife.11695. View

12.

Fiuzat E, Rhodes S, Murray E . The Role of Orbitofrontal-Amygdala Interactions in Updating Action-Outcome Valuations in Macaques. J Neurosci. 2017; 37(9):2463-2470. PMC: 5354351. DOI: 10.1523/JNEUROSCI.1839-16.2017. View

13.

Lee S, Shimojo S, ODoherty J . Neural computations underlying arbitration between model-based and model-free learning. Neuron. 2014; 81(3):687-99. PMC: 3968946. DOI: 10.1016/j.neuron.2013.11.028. View

14.

Scarlet J, Delamater A, Campese V, Fein M, Wheeler D . Differential involvement of the basolateral amygdala and orbitofrontal cortex in the formation of sensory-specific associations in conditioned flavor preference and magazine approach paradigms. Eur J Neurosci. 2012; 35(11):1799-809. PMC: 3376021. DOI: 10.1111/j.1460-9568.2012.08113.x. View

15.

Kahnt T, Heinzle J, Park S, Haynes J . The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A. 2010; 107(13):6010-5. PMC: 2851854. DOI: 10.1073/pnas.0912838107. View

16.

Gallagher M, McMahan R, Schoenbaum G . Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci. 1999; 19(15):6610-4. PMC: 6782791. View

17.

Sadacca B, Jones J, Schoenbaum G . Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework. Elife. 2016; 5. PMC: 4805544. DOI: 10.7554/eLife.13665. View

18.

Wied H, Jones J, Cooch N, Berg B, Schoenbaum G . Disruption of model-based behavior and learning by cocaine self-administration in rats. Psychopharmacology (Berl). 2013; 229(3):493-501. PMC: 3982792. DOI: 10.1007/s00213-013-3222-6. View

19.

Johnson A, Gallagher M, Holland P . The basolateral amygdala is critical to the expression of pavlovian and instrumental outcome-specific reinforcer devaluation effects. J Neurosci. 2009; 29(3):696-704. PMC: 3230882. DOI: 10.1523/JNEUROSCI.3758-08.2009. View

20.

Kurth-Nelson Z, Barnes G, Sejdinovic D, Dolan R, Dayan P . Temporal structure in associative retrieval. Elife. 2015; 4. PMC: 4303761. DOI: 10.7554/eLife.04919. View