Should I Stay or Should I Go? Transformation of Time-discounted Rewards in Orbitofrontal Cortex and Associated Brain Circuits

Overview

Journal Ann N Y Acad Sci

Specialty Science

Date 2007 Mar 9

PMID 17344533

Citations 32

Authors

Matthew R Roesch

Donna J Calu

Kathryn A Burke

Geoffrey Schoenbaum

Affiliations

Soon will be listed here.

Abstract

Animals prefer a small, immediate reward over a larger delayed reward (time discounting). Lesions of the orbitofrontal cortex (OFC) can either increase or decrease the breakpoint at which animals abandon the large delayed reward for the more immediate reward as the delay becomes longer. Here we argue that the varied effects of OFC lesions on delayed discounting reflect two different patterns of activity in OFC; one that bridges the gap between a response and an outcome and another that discounts delayed reward. These signals appear to reflect the spatial location of the reward and/or the action taken to obtain it, and are encoded independently from representations of absolute value. We suggest a dual role for output from OFC in both discounting delayed reward, while at the same time supporting new learning for them.

Citing Articles

Lateral Orbitofrontal Cortex Encodes Presence of Risk and Subjective Risk Preference During Decision-Making.

Gabriel D, Havugimana F, Liley A, Aguilar I, Yeasin M, Simon N bioRxiv. 2024; .

PMID: 38645204 PMC: 11030364. DOI: 10.1101/2024.04.08.588332.

Neural dynamics underlying self-control in the primate subthalamic nucleus.

Pasquereau B, Turner R Elife. 2023; 12.

PMID: 37204300 PMC: 10259453. DOI: 10.7554/eLife.83971.

A framework for understanding and advancing intertemporal choice research using rodent models.

Fobbs W, Mizumori S Neurobiol Learn Mem. 2017; 139:89-97.

PMID: 28065715 PMC: 5407470. DOI: 10.1016/j.nlm.2017.01.004.

Chronic Intermittent Ethanol Exposure Enhances the Excitability and Synaptic Plasticity of Lateral Orbitofrontal Cortex Neurons and Induces a Tolerance to the Acute Inhibitory Actions of Ethanol.

Nimitvilai S, Lopez M, Mulholland P, Woodward J Neuropsychopharmacology. 2015; 41(4):1112-27.

PMID: 26286839 PMC: 4748436. DOI: 10.1038/npp.2015.250.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action.

Bissonette G, Roesch M Curr Top Behav Neurosci. 2015; 27:199-230.

PMID: 26276036 PMC: 5291123. DOI: 10.1007/7854_2015_382.

References

Corwin J, Fussinger M, Meyer R, King V, Reep R . Bilateral destruction of the ventrolateral orbital cortex produces allocentric but not egocentric spatial deficits in rats. Behav Brain Res. 1994; 61(1):79-86. DOI: 10.1016/0166-4328(94)90010-8. View

Roesch M, Olson C . Neuronal activity related to reward value and motivation in primate frontal cortex. Science. 2004; 304(5668):307-10. DOI: 10.1126/science.1093223. View

Wallis J, Miller E . Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci. 2003; 18(7):2069-81. DOI: 10.1046/j.1460-9568.2003.02922.x. View

Kheramin S, Body S, Mobini S, Ho M, Velazquez-Martinez D, Bradshaw C . Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl). 2002; 165(1):9-17. DOI: 10.1007/s00213-002-1228-6. View

Montague P, Berns G . Neural economics and the biological substrates of valuation. Neuron. 2002; 36(2):265-84. DOI: 10.1016/s0896-6273(02)00974-1. View

Kringelbach M . The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci. 2005; 6(9):691-702. DOI: 10.1038/nrn1747. View

Feierstein C, Quirk M, Uchida N, Sosulski D, Mainen Z . Representation of spatial goals in rat orbitofrontal cortex. Neuron. 2006; 51(4):495-507. DOI: 10.1016/j.neuron.2006.06.032. View

Hikosaka K, Watanabe M . Long- and short-range reward expectancy in the primate orbitofrontal cortex. Eur J Neurosci. 2004; 19(4):1046-54. DOI: 10.1111/j.0953-816x.2004.03120.x. View

Rolls E . The orbitofrontal cortex. Philos Trans R Soc Lond B Biol Sci. 1996; 351(1346):1433-43; discussion 1443-4. DOI: 10.1098/rstb.1996.0128. View

10.

Schoenbaum G, Chiba A, Gallagher M . Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci. 1999; 1(2):155-9. DOI: 10.1038/407. View

11.

Kalenscher T, Windmann S, Diekamp B, Rose J, Gunturkun O, Colombo M . Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol. 2005; 15(7):594-602. DOI: 10.1016/j.cub.2005.02.052. View

12.

Pickens C, Saddoris M, Setlow B, Gallagher M, Holland P, Schoenbaum G . Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci. 2003; 23(35):11078-84. PMC: 6741041. View

13.

Gottfried J, ODoherty J, Dolan R . Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science. 2003; 301(5636):1104-7. DOI: 10.1126/science.1087919. View

14.

Tremblay L, Schultz W . Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol. 2000; 83(4):1864-76. DOI: 10.1152/jn.2000.83.4.1864. View

15.

Schoenbaum G, Roesch M . Orbitofrontal cortex, associative learning, and expectancies. Neuron. 2005; 47(5):633-6. PMC: 2628809. DOI: 10.1016/j.neuron.2005.07.018. View

16.

Roesch M, Taylor A, Schoenbaum G . Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron. 2006; 51(4):509-20. PMC: 2561990. DOI: 10.1016/j.neuron.2006.06.027. View

17.

Reep R, Corwin J, King V . Neuronal connections of orbital cortex in rats: topography of cortical and thalamic afferents. Exp Brain Res. 1996; 111(2):215-32. DOI: 10.1007/BF00227299. View

18.

Mobini S, Body S, Ho M, Bradshaw C, Szabadi E, Deakin J . Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl). 2002; 160(3):290-8. DOI: 10.1007/s00213-001-0983-0. View

19.

Winstanley C, Theobald D, Cardinal R, Robbins T . Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci. 2004; 24(20):4718-22. PMC: 6729470. DOI: 10.1523/JNEUROSCI.5606-03.2004. View

20.

Lipton P, Alvarez P, Eichenbaum H . Crossmodal associative memory representations in rodent orbitofrontal cortex. Neuron. 1999; 22(2):349-59. DOI: 10.1016/s0896-6273(00)81095-8. View