The Role of Ventral Frontostriatal Circuitry in Reward-based Learning in Humans

Overview

Journal J Neurosci

Specialty Neurology

Date 2005 Sep 24

PMID 16177032

Citations 95

Authors

Adriana Galvan

Todd A Hare

Matthew Davidson

Julie Spicer

Gary Glover

B J Casey

Affiliations

Soon will be listed here.

Abstract

This study examined changes in behavior and neural activity with reward learning. Using an event-related functional magnetic resonance imaging paradigm, we show that the nucleus accumbens, thalamus, and orbital frontal cortex are each sensitive to reward magnitude, with the accumbens showing the greatest discrimination between reward values. Mean reaction times were significantly faster to cues predicting the greatest reward and slower to cues predicting the smallest reward. This behavioral change over the course of the experiment was paralleled by a shift in peak in accumbens activity from anticipation of the reward (immediately after the response), to the cue predicting the reward. The orbitofrontal and thalamic regions peaked in anticipation of the reward throughout the experiment. Our findings suggest discrete functions of regions within basal ganglia thalamocortical circuitry in adjusting behavior to maximize reward.

Citing Articles

Altered neural signalling during reward anticipation in children and early adolescents with high psychotic-like experiences.

Sen P, Knolle F Neuroimage Clin. 2025; 45:103756.

PMID: 39983553 PMC: 11889563. DOI: 10.1016/j.nicl.2025.103756.

Uncovering the correlation between neurotransmitter-specific functional connectivity and multidimensional anxiety in a non-clinical cohort.

Saiz-Masvidal C, De la Pena-Arteaga V, Bertolin S, Martinez-Zalacain I, Juaneda-Segui A, Chavarria-Elizondo P Eur Arch Psychiatry Clin Neurosci. 2024; .

PMID: 39190041 DOI: 10.1007/s00406-024-01879-9.

Exposure to community violence as a mechanism linking neighborhood socioeconomic disadvantage and neural responses to reward.

Westerman H, Suarez G, Richmond-Rakerd L, Nusslock R, Klump K, Burt S Soc Cogn Affect Neurosci. 2024; 19(1).

PMID: 38619118 PMC: 11079326. DOI: 10.1093/scan/nsae029.

Support from a Best Friend Makes People Eat Less under Stress: Evidence from Two Experiments.

Xiao M, Luo Y, Zeng W, Chen H Nutrients. 2023; 15(18).

PMID: 37764682 PMC: 10537042. DOI: 10.3390/nu15183898.

D Agonist during Learning Potentiates Cued Risky Choice.

Mortazavi L, Hynes T, Chernoff C, Ramaiah S, Brodie H, Russell B J Neurosci. 2023; 43(6):979-992.

PMID: 36623876 PMC: 9908318. DOI: 10.1523/JNEUROSCI.1459-22.2022.

References

Hollerman J, Schultz W . Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci. 1999; 1(4):304-9. DOI: 10.1038/1124. View

Tremblay L, Schultz W . Relative reward preference in primate orbitofrontal cortex. Nature. 1999; 398(6729):704-8. DOI: 10.1038/19525. View

Leon M, Shadlen M . Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron. 1999; 24(2):415-25. DOI: 10.1016/s0896-6273(00)80854-5. View

ODoherty J, Rolls E, Francis S, Bowtell R, McGlone F, Kobal G . Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex. Neuroreport. 2000; 11(4):893-7. DOI: 10.1097/00001756-200003200-00046. View

MacDonald 3rd A, Cohen J, Stenger V, Carter C . Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science. 2000; 288(5472):1835-8. DOI: 10.1126/science.288.5472.1835. View

Robinson T, Berridge K . The psychology and neurobiology of addiction: an incentive-sensitization view. Addiction. 2000; 95 Suppl 2:S91-117. DOI: 10.1080/09652140050111681. View

Delgado M, Nystrom L, Fissell C, Noll D, Fiez J . Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol. 2000; 84(6):3072-7. DOI: 10.1152/jn.2000.84.6.3072. View

ODoherty J, Kringelbach M, Rolls E, Hornak J, Andrews C . Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci. 2001; 4(1):95-102. DOI: 10.1038/82959. View

Berns G, McClure S, Pagnoni G, Montague P . Predictability modulates human brain response to reward. J Neurosci. 2001; 21(8):2793-8. PMC: 6762527. View

10.

Wallis J, Dias R, Robbins T, Roberts A . Dissociable contributions of the orbitofrontal and lateral prefrontal cortex of the marmoset to performance on a detour reaching task. Eur J Neurosci. 2001; 13(9):1797-808. DOI: 10.1046/j.0953-816x.2001.01546.x. View

11.

Fuster J . The prefrontal cortex--an update: time is of the essence. Neuron. 2001; 30(2):319-33. DOI: 10.1016/s0896-6273(01)00285-9. View

12.

Knutson B, Adams C, Fong G, Hommer D . Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci. 2001; 21(16):RC159. PMC: 6763187. View

13.

Hyman S, Malenka R . Addiction and the brain: the neurobiology of compulsion and its persistence. Nat Rev Neurosci. 2001; 2(10):695-703. DOI: 10.1038/35094560. View

14.

Knutson B, Fong G, Adams C, Varner J, Hommer D . Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 2001; 12(17):3683-7. DOI: 10.1097/00001756-200112040-00016. View

15.

Dagenbach D, Absher J . Human verbal working memory impairments associated with thalamic damage. Int J Neurosci. 2002; 111(1-2):67-87. DOI: 10.3109/00207450108986553. View

16.

Ito R, Dalley J, Robbins T, Everitt B . Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J Neurosci. 2002; 22(14):6247-53. PMC: 6757945. DOI: 20026606. View

17.

McFarland N, Haber S . Thalamic relay nuclei of the basal ganglia form both reciprocal and nonreciprocal cortical connections, linking multiple frontal cortical areas. J Neurosci. 2002; 22(18):8117-32. PMC: 6758100. View

18.

Dayan P, Balleine B . Reward, motivation, and reinforcement learning. Neuron. 2002; 36(2):285-98. DOI: 10.1016/s0896-6273(02)00963-7. View

19.

Kubat-Silman A, Dagenbach D, Absher J . Patterns of impaired verbal, spatial, and object working memory after thalamic lesions. Brain Cogn. 2002; 50(2):178-93. DOI: 10.1016/s0278-2626(02)00502-x. View

20.

Elliott R, Newman J, Longe O, Deakin J . Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci. 2003; 23(1):303-7. PMC: 6742125. View