» Articles » PMID: 27181060

Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency

Overview
Journal Neuron
Publisher Cell Press
Specialty Neurology
Date 2016 May 17
PMID 27181060
Citations 41
Authors
Affiliations
Soon will be listed here.
Abstract

Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning.

Citing Articles

Understanding learning through uncertainty and bias.

Bruckner R, Heekeren H, Nassar M Commun Psychol. 2025; 3(1):24.

PMID: 39948273 PMC: 11825852. DOI: 10.1038/s44271-025-00203-y.


Methamphetamine-induced adaptation of learning rate dynamics depend on baseline performance.

Kirschner H, Molla H, Nassar M, de Wit H, Ullsperger M bioRxiv. 2024; .

PMID: 39026741 PMC: 11257491. DOI: 10.1101/2024.07.04.602054.


Adaptive coding of reward in schizophrenia, its change over time and relationship to apathy.

Kaliuzhna M, Carruzzo F, Kuenzi N, Tobler P, Kirschner M, Geffen T Brain. 2024; 147(7):2459-2470.

PMID: 38608149 PMC: 11224610. DOI: 10.1093/brain/awae112.


Observational reinforcement learning in children and young adults.

Rodriguez Buritica J, Eppinger B, Heekeren H, Crone E, van Duijvenvoorde A NPJ Sci Learn. 2024; 9(1):18.

PMID: 38480747 PMC: 10937639. DOI: 10.1038/s41539-024-00227-9.


Liraglutide restores impaired associative learning in individuals with obesity.

Hanssen R, Rigoux L, Kuzmanovic B, Iglesias S, Kretschmer A, Schlamann M Nat Metab. 2023; 5(8):1352-1363.

PMID: 37592007 PMC: 10447249. DOI: 10.1038/s42255-023-00859-y.


References
1.
Gruber M, Gelman B, Ranganath C . States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron. 2014; 84(2):486-96. PMC: 4252494. DOI: 10.1016/j.neuron.2014.08.060. View

2.
Cox K, Kable J . BOLD subjective value signals exhibit robust range adaptation. J Neurosci. 2014; 34(49):16533-43. PMC: 4252558. DOI: 10.1523/JNEUROSCI.3927-14.2014. View

3.
Carandini M, Heeger D . Normalization as a canonical neural computation. Nat Rev Neurosci. 2011; 13(1):51-62. PMC: 3273486. DOI: 10.1038/nrn3136. View

4.
Hahn B, Ross T, Stein E . Neuroanatomical dissociation between bottom-up and top-down processes of visuospatial selective attention. Neuroimage. 2006; 32(2):842-53. PMC: 2652125. DOI: 10.1016/j.neuroimage.2006.04.177. View

5.
Krugel L, Biele G, Mohr P, Li S, Heekeren H . Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proc Natl Acad Sci U S A. 2009; 106(42):17951-6. PMC: 2760487. DOI: 10.1073/pnas.0905191106. View