» Articles » PMID: 27101365

The Modulation of Savouring by Prediction Error and Its Effects on Choice

Overview
Journal Elife
Specialty Biology
Date 2016 Apr 22
PMID 27101365
Citations 43
Authors
Affiliations
Soon will be listed here.
Abstract

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling.

Citing Articles

Striatal-hippocampal functional connectivity contributes to real-life positive anticipatory experiences and subjective well-being.

Shin W, Jyung M, Choi J, Choi I, Sul S Soc Cogn Affect Neurosci. 2024; 19(1).

PMID: 39697134 PMC: 11686551. DOI: 10.1093/scan/nsae096.


Computational and Neural Evidence for Altered Fast and Slow Learning from Losses in Problem Gambling.

Iigaya K, Larsen T, Fong T, ODoherty J J Neurosci. 2024; 45(1).

PMID: 39557579 PMC: 11694394. DOI: 10.1523/JNEUROSCI.0080-24.2024.


Rats' performance in a suboptimal choice procedure implemented in a natural-foraging analogue.

Gonzalez-Barriga F, Orduna V Anim Cogn. 2024; 27(1):72.

PMID: 39485623 PMC: 11530512. DOI: 10.1007/s10071-024-01913-2.


Autistic traits foster effective curiosity-driven exploration.

Poli F, Koolen M, Velazquez-Vargas C, Ramos-Sanchez J, Meyer M, Mars R PLoS Comput Biol. 2024; 20(10):e1012453.

PMID: 39480751 PMC: 11527316. DOI: 10.1371/journal.pcbi.1012453.


Individual differences in information demand have a low dimensional structure predicted by some curiosity traits.

Jach H, Cools R, Frisvold A, Grubb M, Hartley C, Hartmann J Proc Natl Acad Sci U S A. 2024; 121(45):e2415236121.

PMID: 39467138 PMC: 11551435. DOI: 10.1073/pnas.2415236121.


References
1.
Schultz W, Dayan P, Montague P . A neural substrate of prediction and reward. Science. 1997; 275(5306):1593-9. DOI: 10.1126/science.275.5306.1593. View

2.
Lammel S, Lim B, Malenka R . Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology. 2013; 76 Pt B:351-9. PMC: 3778102. DOI: 10.1016/j.neuropharm.2013.03.019. View

3.
Kable J, Glimcher P . An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol. 2010; 103(5):2513-31. PMC: 2867580. DOI: 10.1152/jn.00177.2009. View

4.
McCoy A, Platt M . Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci. 2005; 8(9):1220-7. DOI: 10.1038/nn1523. View

5.
Bromberg-Martin E, Hikosaka O . Lateral habenula neurons signal errors in the prediction of reward information. Nat Neurosci. 2011; 14(9):1209-16. PMC: 3164948. DOI: 10.1038/nn.2902. View