» Articles » PMID: 35537273

Reinforcement Learning and Bayesian Inference Provide Complementary Models for the Unique Advantage of Adolescents in Stochastic Reversal

Overview
Publisher Elsevier
Specialties Neurology
Psychiatry
Date 2022 May 10
PMID 35537273
Authors
Affiliations
Soon will be listed here.
Abstract

During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8-30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference (BI). The RL parameter for learning from negative outcomes and the BI parameters specifying participants' mental models were closest to optimal in mid-teen adolescents, suggesting a central role in adolescent cognitive processing. By contrast, persistence and noise parameters improved monotonically with age. We distilled the insights of RL and BI using principal component analysis and found that three shared components interacted to form the adolescent performance peak: adult-like behavioral quality, child-like time scales, and developmentally-unique processing of positive feedback. This research highlights adolescence as a neurodevelopmental window that can create performance advantages in volatile and uncertain environments. It also shows how detailed insights can be gleaned by using cognitive models in new ways.

Citing Articles

Relevance of Probabilistic Reversal Learning for Adolescent Drinking Trajectories.

Frohner J, Waltmann M, Reiter A, Kraplin A, Smolka M Addict Biol. 2025; 30(3):e70026.

PMID: 40049217 PMC: 11884864. DOI: 10.1111/adb.70026.


Decrease in decision noise from adolescence into adulthood mediates an increase in more sophisticated choice behaviors and performance gain.

Scholz V, Waltmann M, Herzog N, Horstmann A, Deserno L PLoS Biol. 2024; 22(11):e3002877.

PMID: 39541313 PMC: 11563475. DOI: 10.1371/journal.pbio.3002877.


Mapping computational cognitive profiles of aging to dissociable brain and sociodemographic factors.

Marzuki A, Wong K, Chan J, Na S, Thanaraju A, Phon-Amnuaisuk P NPJ Aging. 2024; 10(1):50.

PMID: 39482289 PMC: 11527976. DOI: 10.1038/s41514-024-00171-3.


Revisiting the role of computational neuroimaging in the era of integrative neuroscience.

Loosen A, Kato A, Gu X Neuropsychopharmacology. 2024; 50(1):103-113.

PMID: 39242921 PMC: 11525590. DOI: 10.1038/s41386-024-01946-8.


Positive affect modulates memory by regulating the influence of reward prediction errors.

Qasim S, Deswal A, Saez I, Gu X Commun Psychol. 2024; 2(1):52.

PMID: 39242805 PMC: 11332028. DOI: 10.1038/s44271-024-00106-4.


References
1.
Davidow J, Foerde K, Galvan A, Shohamy D . An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence. Neuron. 2016; 92(1):93-99. DOI: 10.1016/j.neuron.2016.08.031. View

2.
Eckstein M, Master S, Xia L, Dahl R, Wilbrecht L, Collins A . The interpretation of computational model parameters depends on the context. Elife. 2022; 11. PMC: 9635876. DOI: 10.7554/eLife.75474. View

3.
Solway A, Botvinick M . Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. Psychol Rev. 2012; 119(1):120-54. PMC: 3767755. DOI: 10.1037/a0026435. View

4.
Newman L, McGaughy J . Adolescent rats show cognitive rigidity in a test of attentional set shifting. Dev Psychobiol. 2011; 53(4):391-401. PMC: 10722888. DOI: 10.1002/dev.20537. View

5.
Izquierdo A, Jentsch J . Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology (Berl). 2011; 219(2):607-20. PMC: 3249486. DOI: 10.1007/s00213-011-2579-7. View