» Articles » PMID: 31850844

Catecholaminergic Modulation of Meta-learning

Overview
Journal Elife
Specialty Biology
Date 2019 Dec 19
PMID 31850844
Citations 11
Authors
Affiliations
Soon will be listed here.
Abstract

The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.

Citing Articles

Noradrenergic alpha-2a receptor stimulation enhances prediction error signaling and updating of attention sets in anterior cingulate cortex and striatum.

Hassani S, Tiesinga P, Womelsdorf T Nat Commun. 2024; 15(1):9905.

PMID: 39548091 PMC: 11568163. DOI: 10.1038/s41467-024-54395-8.


Methamphetamine-induced adaptation of learning rate dynamics depend on baseline performance.

Kirschner H, Molla H, Nassar M, de Wit H, Ullsperger M bioRxiv. 2024; .

PMID: 39026741 PMC: 11257491. DOI: 10.1101/2024.07.04.602054.


A Computational Model of Hopelessness and Active-Escape Bias in Suicidality.

Karvelis P, Diaconescu A Comput Psychiatr. 2024; 6(1):34-59.

PMID: 38774778 PMC: 11104346. DOI: 10.5334/cpsy.80.


Two Determinants of Dynamic Adaptive Learning for Magnitudes and Probabilities.

Foucault C, Meyniel F Open Mind (Camb). 2024; 8:615-638.

PMID: 38746853 PMC: 11093407. DOI: 10.1162/opmi_a_00139.


Learning environment-specific learning rates.

Simoens J, Verguts T, Braem S PLoS Comput Biol. 2024; 20(3):e1011978.

PMID: 38517916 PMC: 10990245. DOI: 10.1371/journal.pcbi.1011978.


References
1.
Marshall L, Mathys C, Ruge D, de Berker A, Dayan P, Stephan K . Pharmacological Fingerprints of Contextual Uncertainty. PLoS Biol. 2016; 14(11):e1002575. PMC: 5113004. DOI: 10.1371/journal.pbio.1002575. View

2.
Lee D, Conroy M, McGreevy B, Barraclough D . Reinforcement learning and decision making in monkeys during a competitive game. Brain Res Cogn Brain Res. 2004; 22(1):45-58. DOI: 10.1016/j.cogbrainres.2004.07.007. View

3.
Pelli D . The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis. 1997; 10(4):437-42. View

4.
Lavin C, San Martin R, Jubal E . Pupil dilation signals uncertainty and surprise in a learning gambling task. Front Behav Neurosci. 2014; 7:218. PMC: 3879532. DOI: 10.3389/fnbeh.2013.00218. View

5.
Collins A, Frank M . Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning. Cognition. 2016; 152:160-169. PMC: 5595218. DOI: 10.1016/j.cognition.2016.04.002. View