» Articles » PMID: 22508958

Dopamine and Performance in a Reinforcement Learning Task: Evidence from Parkinson's Disease

Overview
Journal Brain
Specialty Neurology
Date 2012 Apr 18
PMID 22508958
Citations 76
Authors
Affiliations
Soon will be listed here.
Abstract

The role dopamine plays in decision-making has important theoretical, empirical and clinical implications. Here, we examined its precise contribution by exploiting the lesion deficit model afforded by Parkinson's disease. We studied patients in a two-stage reinforcement learning task, while they were ON and OFF dopamine replacement medication. Contrary to expectation, we found that dopaminergic drug state (ON or OFF) did not impact learning. Instead, the critical factor was drug state during the performance phase, with patients ON medication choosing correctly significantly more frequently than those OFF medication. This effect was independent of drug state during initial learning and appears to reflect a facilitation of generalization for learnt information. This inference is bolstered by our observation that neural activity in nucleus accumbens and ventromedial prefrontal cortex, measured during simultaneously acquired functional magnetic resonance imaging, represented learnt stimulus values during performance. This effect was expressed solely during the ON state with activity in these regions correlating with better performance. Our data indicate that dopamine modulation of nucleus accumbens and ventromedial prefrontal cortex exerts a specific effect on choice behaviour distinct from pure learning. The findings are in keeping with the substantial other evidence that certain aspects of learning are unaffected by dopamine lesions or depletion, and that dopamine plays a key role in performance that may be distinct from its role in learning.

Citing Articles

Gambling Environment Exposure Increases Temporal Discounting but Improves Model-Based Control in Regular Slot-Machine Gamblers.

Wagner B, Mathar D, Peters J Comput Psychiatr. 2024; 6(1):142-165.

PMID: 38774777 PMC: 11104401. DOI: 10.5334/cpsy.84.


Impaired value-based decision-making in Parkinson's disease apathy.

Gilmour W, MacKenzie G, Feile M, Tayler-Grint L, Suveges S, Macfarlane J Brain. 2024; 147(4):1362-1376.

PMID: 38305691 PMC: 10994558. DOI: 10.1093/brain/awae025.


Advances in clinical basic research: Performance, treatments, and mechanisms of Parkinson disease.

Yang T, Liu Y, Li J, Xu H, Li S, Xiong L Ibrain. 2023; 7(4):362-378.

PMID: 37786563 PMC: 10529016. DOI: 10.1002/ibra.12011.


Reliability of gamified reinforcement learning in densely sampled longitudinal assessments.

Neuser M, Kuhnel A, Krautlein F, Teckentrup V, Svaldi J, Kroemer N PLOS Digit Health. 2023; 2(9):e0000330.

PMID: 37672521 PMC: 10482292. DOI: 10.1371/journal.pdig.0000330.


A Brief Review on the Potential of Psychedelics for Treating Alzheimer's Disease and Related Depression.

Pilozzi A, Foster S, Mischoulon D, Fava M, Huang X Int J Mol Sci. 2023; 24(15).

PMID: 37569888 PMC: 10419627. DOI: 10.3390/ijms241512513.


References
1.
Jocham G, Klein T, Ullsperger M . Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J Neurosci. 2011; 31(5):1606-13. PMC: 6623749. DOI: 10.1523/JNEUROSCI.3904-10.2011. View

2.
Myers C, Shohamy D, Gluck M, Grossman S, Kluger A, Ferris S . Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J Cogn Neurosci. 2003; 15(2):185-93. DOI: 10.1162/089892903321208123. View

3.
Luk C, Wallis J . Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. J Neurosci. 2009; 29(23):7526-39. PMC: 2718717. DOI: 10.1523/JNEUROSCI.0386-09.2009. View

4.
Shohamy D, Myers C, Geghman K, Sage J, Gluck M . L-dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia. 2005; 44(5):774-84. PMC: 1626444. DOI: 10.1016/j.neuropsychologia.2005.07.013. View

5.
McClure S, Daw N, Montague P . A computational substrate for incentive salience. Trends Neurosci. 2003; 26(8):423-8. DOI: 10.1016/s0166-2236(03)00177-2. View