» Articles » PMID: 21173266

How Instructed Knowledge Modulates the Neural Systems of Reward Learning

Overview
Specialty Science
Date 2010 Dec 22
PMID 21173266
Citations 72
Authors
Affiliations
Soon will be listed here.
Abstract

Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.

Citing Articles

Reinforcement-Learning-Informed Queries Guide Behavioral Change.

Brown V, Lee J, Wang J, Casas B, Chiu P Clin Psychol Sci. 2024; 12(6):1146-1161.

PMID: 39635456 PMC: 11617014. DOI: 10.1177/21677026231213368.


Galanin receptor 1 expressing neurons in hippocampal-prefrontal circuitry modulate goal directed attention and impulse control.

Messanvi F, Visocky V, Senneca C, Berkun K, Taori M, Bradley S bioRxiv. 2024; .

PMID: 39131306 PMC: 11312591. DOI: 10.1101/2024.07.29.605653.


Comparing experience- and description-based economic preferences across 11 countries.

Anllo H, Bavard S, Benmarrakchi F, Bonagura D, Cerrotti F, Cicue M Nat Hum Behav. 2024; 8(8):1554-1567.

PMID: 38877287 DOI: 10.1038/s41562-024-01894-9.


Disentangling the contribution of individual and social learning processes in human advice-taking behavior.

Pereg M, Hertz U, Ben-Artzi I, Shahar N NPJ Sci Learn. 2024; 9(1):4.

PMID: 38245562 PMC: 10799906. DOI: 10.1038/s41539-024-00214-0.


Human ventromedial prefrontal cortex lesions enhance the effect of expectations on pain perception.

Motzkin J, Hiser J, Carroll I, Wolf R, Baskaya M, Koenigs M Cortex. 2023; 166:188-206.

PMID: 37390595 PMC: 10528632. DOI: 10.1016/j.cortex.2023.04.017.


References
1.
Knoch D, Fehr E . Resisting the power of temptations: the right prefrontal cortex and self-control. Ann N Y Acad Sci. 2007; 1104:123-34. DOI: 10.1196/annals.1390.004. View

2.
ODoherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan R . Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science. 2004; 304(5669):452-4. DOI: 10.1126/science.1094285. View

3.
Ochsner K, Gross J . The cognitive control of emotion. Trends Cogn Sci. 2005; 9(5):242-9. DOI: 10.1016/j.tics.2005.03.010. View

4.
ODoherty J, Rolls E, Francis S, Bowtell R, McGlone F . Representation of pleasant and aversive taste in the human brain. J Neurophysiol. 2001; 85(3):1315-21. DOI: 10.1152/jn.2001.85.3.1315. View

5.
Aharon I, Etcoff N, Ariely D, Chabris C, OConnor E, Breiter H . Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron. 2001; 32(3):537-51. DOI: 10.1016/s0896-6273(01)00491-3. View