Neural Circuits for Inference-based Decision-making

Overview

Journal Curr Opin Behav Sci

Date 2021 Mar 15

PMID 33718535

Citations 8

Authors

Fang Wang

Thorsten Kahnt

Affiliations

Soon will be listed here.

Abstract

In novel situations, where direct experience is lacking or outdated, humans must rely on mental simulations to predict future outcomes. This review discusses recent work on the neural circuits that support such inference-based behavior. We focus on two specific examples: 1) using knowledge about the associative structure of the world to infer outcomes when direct experience is lacking; 2) inferring the current value of options when the desirability of the associated outcome has changed since the original learning experience. These two examples can be studied in the sensory preconditioning and devaluation tasks, respectively. We review results from studies in animals and humans suggesting that the orbitofrontal cortex (OFC), together with the hippocampus and amygdala, is necessary for inference in both of these tasks. Together, these findings suggest that the OFC is a critical hub in the brain network that supports inference-based decision-making.

Citing Articles

Neural mechanisms of credit assignment for delayed outcomes during contingent learning.

Witkowski P, Rondot L, Kurth-Nelson Z, Garvert M, Dolan R, Behrens T bioRxiv. 2024; .

PMID: 39149338 PMC: 11326259. DOI: 10.1101/2024.08.06.606895.

Hippocampal and orbitofrontal neurons contribute to complementary aspects of associative structure.

Lin H, Zhou J Nat Commun. 2024; 15(1):5283.

PMID: 38902232 PMC: 11190210. DOI: 10.1038/s41467-024-49652-9.

Midbrain signaling of identity prediction errors depends on orbitofrontal cortex networks.

Liu Q, Zhao Y, Attanti S, Voss J, Schoenbaum G, Kahnt T Nat Commun. 2024; 15(1):1704.

PMID: 38402210 PMC: 10894191. DOI: 10.1038/s41467-024-45880-1.

Lateral orbitofrontal cortex integrates predictive information across multiple cues to guide behavior.

Tegelbeckers J, Porter D, Voss J, Schoenbaum G, Kahnt T Curr Biol. 2023; 33(20):4496-4504.e5.

PMID: 37804827 PMC: 10622115. DOI: 10.1016/j.cub.2023.09.033.

Emotional learning retroactively promotes memory integration through rapid neural reactivation and reorganization.

Zhu Y, Zeng Y, Ren J, Zhang L, Chen C, Fernandez G Elife. 2022; 11.

PMID: 36476501 PMC: 9815824. DOI: 10.7554/eLife.60190.

References

Gallagher M, McMahan R, Schoenbaum G . Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci. 1999; 19(15):6610-4. PMC: 6782791. View

Vikbladh O, Meager M, King J, Blackmon K, Devinsky O, Shohamy D . Hippocampal Contributions to Model-Based Planning and Spatial Memory. Neuron. 2019; 102(3):683-693.e4. PMC: 6508991. DOI: 10.1016/j.neuron.2019.02.014. View

Hampton A, Bossaerts P, ODoherty J . The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci. 2006; 26(32):8360-7. PMC: 6673813. DOI: 10.1523/JNEUROSCI.1010-06.2006. View

Gardner M, Conroy J, Shaham M, Styer C, Schoenbaum G . Lateral Orbitofrontal Inactivation Dissociates Devaluation-Sensitive Behavior and Economic Choice. Neuron. 2017; 96(5):1192-1203.e4. PMC: 5728681. DOI: 10.1016/j.neuron.2017.10.026. View

Izquierdo A, Suda R, Murray E . Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci. 2004; 24(34):7540-8. PMC: 6729636. DOI: 10.1523/JNEUROSCI.1921-04.2004. View

Barron H, Reeve H, Koolschijn R, Perestenko P, Shpektor A, Nili H . Neuronal Computation Underlying Inferential Reasoning in Humans and Mice. Cell. 2020; 183(1):228-243.e21. PMC: 7116148. DOI: 10.1016/j.cell.2020.08.035. View

BROGDEN W . Sensory pre-conditioning of human subjects. J Exp Psychol. 1947; 37(6):527-39. DOI: 10.1037/h0058465. View

Padoa-Schioppa C, Assad J . Neurons in the orbitofrontal cortex encode economic value. Nature. 2006; 441(7090):223-6. PMC: 2630027. DOI: 10.1038/nature04676. View

Sadacca B, Wied H, Lopatina N, Saini G, Nemirovsky D, Schoenbaum G . Orbitofrontal neurons signal sensory associations underlying model-based inference in a sensory preconditioning task. Elife. 2018; 7. PMC: 5847331. DOI: 10.7554/eLife.30373. View

10.

Zhou J, Gardner M, Stalnaker T, Ramus S, Wikenheiser A, Niv Y . Rat Orbitofrontal Ensemble Activity Contains Multiplexed but Dissociable Representations of Value and Task Structure in an Odor Sequence Task. Curr Biol. 2019; 29(6):897-907.e3. PMC: 9445914. DOI: 10.1016/j.cub.2019.01.048. View

11.

Bradfield L, Dezfouli A, van Holstein M, Chieng B, Balleine B . Medial Orbitofrontal Cortex Mediates Outcome Retrieval in Partially Observable Task Situations. Neuron. 2015; 88(6):1268-1280. DOI: 10.1016/j.neuron.2015.10.044. View

12.

Howard J, Kahnt T . Identity prediction errors in the human midbrain update reward-identity expectations in the orbitofrontal cortex. Nat Commun. 2018; 9(1):1611. PMC: 5913228. DOI: 10.1038/s41467-018-04055-5. View

13.

Park S, Miller D, Nili H, Ranganath C, Boorman E . Map Making: Constructing, Combining, and Inferring on Abstract Cognitive Maps. Neuron. 2020; 107(6):1226-1238.e8. PMC: 7529977. DOI: 10.1016/j.neuron.2020.06.030. View

14.

Murray E, Moylan E, Saleem K, Basile B, Turchi J . Specialized areas for value updating and goal selection in the primate orbitofrontal cortex. Elife. 2015; 4. PMC: 4739757. DOI: 10.7554/eLife.11695. View

15.

Fiuzat E, Rhodes S, Murray E . The Role of Orbitofrontal-Amygdala Interactions in Updating Action-Outcome Valuations in Macaques. J Neurosci. 2017; 37(9):2463-2470. PMC: 5354351. DOI: 10.1523/JNEUROSCI.1839-16.2017. View

16.

Johnson A, Gallagher M, Holland P . The basolateral amygdala is critical to the expression of pavlovian and instrumental outcome-specific reinforcer devaluation effects. J Neurosci. 2009; 29(3):696-704. PMC: 3230882. DOI: 10.1523/JNEUROSCI.3758-08.2009. View

17.

Xie J, Padoa-Schioppa C . Neuronal remapping and circuit persistence in economic decisions. Nat Neurosci. 2016; 19(6):855-61. PMC: 4882218. DOI: 10.1038/nn.4300. View

18.

Behrens T, Muller T, Whittington J, Mark S, Baram A, Stachenfeld K . What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior. Neuron. 2018; 100(2):490-509. DOI: 10.1016/j.neuron.2018.10.002. View

19.

Rudebeck P, Saunders R, Prescott A, Chau L, Murray E . Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat Neurosci. 2013; 16(8):1140-5. PMC: 3733248. DOI: 10.1038/nn.3440. View

20.

Howard J, Reynolds R, Smith D, Voss J, Schoenbaum G, Kahnt T . Targeted Stimulation of Human Orbitofrontal Networks Disrupts Outcome-Guided Behavior. Curr Biol. 2020; 30(3):490-498.e4. PMC: 7291849. DOI: 10.1016/j.cub.2019.12.007. View