» Articles » PMID: 18595740

Individual Differences in Reinforcement Learning: Behavioral, Electrophysiological, and Neuroimaging Correlates

Overview
Journal Neuroimage
Specialty Radiology
Date 2008 Jul 4
PMID 18595740
Citations 74
Authors
Affiliations
Soon will be listed here.
Abstract

During reinforcement learning, phasic modulations of activity in midbrain dopamine neurons are conveyed to the dorsal anterior cingulate cortex (dACC) and basal ganglia (BG) and serve to guide adaptive responding. While the animal literature supports a role for the dACC in integrating reward history over time, most human electrophysiological studies of dACC function have focused on responses to single positive and negative outcomes. The present electrophysiological study investigated the role of the dACC in probabilistic reward learning in healthy subjects using a task that required integration of reinforcement history over time. We recorded the feedback-related negativity (FRN) to reward feedback in subjects who developed a response bias toward a more frequently rewarded ("rich") stimulus ("learners") versus subjects who did not ("non-learners"). Compared to non-learners, learners showed more positive (i.e., smaller) FRNs and greater dACC activation upon receiving reward for correct identification of the rich stimulus. In addition, dACC activation and a bias to select the rich stimulus were positively correlated. The same participants also completed a monetary incentive delay (MID) task administered during functional magnetic resonance imaging. Compared to non-learners, learners displayed stronger BG responses to reward in the MID task. These findings raise the possibility that learners in the probabilistic reinforcement task were characterized by stronger dACC and BG responses to rewarding outcomes. Furthermore, these results highlight the importance of the dACC to probabilistic reward learning in humans.

Citing Articles

Reward-Related Brain Activity Mediates the Relationship Between Decision-Making Deficits and Pediatric Depression Symptom Severity.

Pitliya R, Burani K, Nelson B, Hajcak G, Jin J Biol Psychiatry Cogn Neurosci Neuroimaging. 2024; 10(2):138-147.

PMID: 38942146 PMC: 11669731. DOI: 10.1016/j.bpsc.2024.06.007.


Using Drift Diffusion and RL Models to Disentangle Effects of Depression On Decision-Making vs. Learning in the Probabilistic Reward Task.

Dillon D, Belleau E, Origlio J, McKee M, Jahan A, Meyer A Comput Psychiatr. 2024; 8(1):46-69.

PMID: 38774430 PMC: 11104335. DOI: 10.5334/cpsy.108.


The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking.

Le T, Oba T, Couch L, McInerney L, Li C eNeuro. 2024; 11(2).

PMID: 38365840 PMC: 10901196. DOI: 10.1523/ENEURO.0437-23.2024.


Social and non-social feedback stimuli lead to comparable levels of reward learning and reward responsiveness in an online probabilistic reward task.

Sailer U, Wurm F, Pfabigan D Behav Res Methods. 2023; 56(5):5161-5177.

PMID: 37845425 PMC: 11289059. DOI: 10.3758/s13428-023-02255-6.


Reliability of gamified reinforcement learning in densely sampled longitudinal assessments.

Neuser M, Kuhnel A, Krautlein F, Teckentrup V, Svaldi J, Kroemer N PLOS Digit Health. 2023; 2(9):e0000330.

PMID: 37672521 PMC: 10482292. DOI: 10.1371/journal.pdig.0000330.


References
1.
McCoy A, Crowley J, Haghighian G, Dean H, Platt M . Saccade reward signals in posterior cingulate cortex. Neuron. 2003; 40(5):1031-40. DOI: 10.1016/s0896-6273(03)00719-0. View

2.
Holroyd C, Krigolson O . Reward prediction error signals associated with a modified time estimation task. Psychophysiology. 2007; 44(6):913-7. DOI: 10.1111/j.1469-8986.2007.00561.x. View

3.
Knutson B, Fong G, Bennett S, Adams C, Hommer D . A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage. 2003; 18(2):263-72. DOI: 10.1016/s1053-8119(02)00057-5. View

4.
Oliveira F, McDonald J, Goodman D . Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J Cogn Neurosci. 2007; 19(12):1994-2004. DOI: 10.1162/jocn.2007.19.12.1994. View

5.
Amiez C, Joseph J, Procyk E . Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex. 2005; 16(7):1040-55. PMC: 1913662. DOI: 10.1093/cercor/bhj046. View