Computational Theory-driven Studies of Reinforcement Learning and Decision-making in Addiction: What Have We Learned?

Overview

Journal Curr Opin Behav Sci

Date 2021 Aug 23

PMID 34423103

Citations 22

Authors

Maelle C M Gueguen

Emma M Schweitzer

Anna B Konova

Affiliations

Soon will be listed here.

Abstract

Computational psychiatry provides a powerful new approach for linking the behavioral manifestations of addiction to their precise cognitive and neurobiological substrates. However, this emerging area of research is still limited in important ways. While research has identified features of reinforcement learning and decision-making in substance users that differ from health, less emphasis has been placed on capturing addiction cycles/states dynamically, within-person. In addition, the focus on few behavioral variables at a time has precluded more detailed consideration of related processes and heterogeneous clinical profiles. We propose that a longitudinal and multidimensional examination of value-based processes, a type of dynamic "computational fingerprint", will provide a more complete understanding of addiction as well as aid in developing better tailored and timed interventions.

Citing Articles

An opponent striatal circuit for distributional reinforcement learning.

Lowet A, Zheng Q, Meng M, Matias S, Drugowitsch J, Uchida N Nature. 2025; .

PMID: 39972123 DOI: 10.1038/s41586-024-08488-5.

An experimental and computational investigation of executive functions and inner speech in schizophrenia spectrum disorders.

Granato G, Costanzo R, Borghi A, Mattera A, Carruthers S, Rossell S Sci Rep. 2025; 15(1):5185.

PMID: 39939690 PMC: 11822060. DOI: 10.1038/s41598-025-89555-3.

Dissociating social reward learning and behavior in alcohol use disorder.

Jangard S, Lindstrom B, Khemiri L, Jayaram-Lindstrom N, Olsson A Transl Psychiatry. 2025; 15(1):30.

PMID: 39863597 PMC: 11762780. DOI: 10.1038/s41398-025-03236-3.

Impact of provoked stress on model-free and model-based reinforcement learning in individuals with alcohol use disorder.

Wyckmans F, Chatard A, Kornreich C, Gruson D, Jaafari N, Noel X Addict Behav Rep. 2024; 20:100574.

PMID: 39659897 PMC: 11629551. DOI: 10.1016/j.abrep.2024.100574.

Computational Mechanisms Underlying Multi-Step Planning Deficits in Methamphetamine Use Disorder.

Lavalley C, Mehta M, Taylor S, Chuning A, Stewart J, Huys Q medRxiv. 2024; .

PMID: 38978681 PMC: 11230339. DOI: 10.1101/2024.06.27.24309581.

References

Groman S . Investigating the computational underpinnings of addiction. Neuropsychopharmacology. 2019; 44(13):2149-2150. PMC: 6897857. DOI: 10.1038/s41386-019-0412-x. View

Hogarth L . Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory. Neuropsychopharmacology. 2020; 45(5):720-735. PMC: 7265389. DOI: 10.1038/s41386-020-0600-8. View

Voon V, Morris L, Irvine M, Ruck C, Worbe Y, Derbyshire K . Risk-taking in disorders of natural and drug rewards: neural correlates and effects of probability, valence, and magnitude. Neuropsychopharmacology. 2014; 40(4):804-12. PMC: 4305336. DOI: 10.1038/npp.2014.242. View

Montague P, Dolan R, Friston K, Dayan P . Computational psychiatry. Trends Cogn Sci. 2011; 16(1):72-80. PMC: 3556822. DOI: 10.1016/j.tics.2011.11.018. View

Ersche K, Gillan C, Jones P, Williams G, Ward L, Luijten M . Carrots and sticks fail to change behavior in cocaine addiction. Science. 2016; 352(6292):1468-71. PMC: 5144994. DOI: 10.1126/science.aaf3700. View

Gu X, Lohrenz T, Salas R, Baldwin P, Soltani A, Kirk U . Belief about nicotine selectively modulates value and reward prediction error signals in smokers. Proc Natl Acad Sci U S A. 2015; 112(8):2539-44. PMC: 4345562. DOI: 10.1073/pnas.1416639112. View

Goldstein R, Volkow N . Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications. Nat Rev Neurosci. 2011; 12(11):652-69. PMC: 3462342. DOI: 10.1038/nrn3119. View

van Timmeren T, Quail S, Balleine B, Geurts D, Goudriaan A, van Holst R . Intact corticostriatal control of goal-directed action in Alcohol Use Disorder: a Pavlovian-to-instrumental transfer and outcome-devaluation study. Sci Rep. 2020; 10(1):4949. PMC: 7087408. DOI: 10.1038/s41598-020-61892-5. View

Tanabe J, Reynolds J, Krmpotich T, Claus E, Thompson L, Du Y . Reduced neural tracking of prediction error in substance-dependent individuals. Am J Psychiatry. 2013; 170(11):1356-63. PMC: 4426095. DOI: 10.1176/appi.ajp.2013.12091257. View

10.

Donamayor N, Strelchuk D, Baek K, Banca P, Voon V . The involuntary nature of binge drinking: goal directedness and awareness of intention. Addict Biol. 2017; 23(1):515-526. PMC: 5811896. DOI: 10.1111/adb.12505. View

11.

Luscher C, Robbins T, Everitt B . The transition to compulsion in addiction. Nat Rev Neurosci. 2020; 21(5):247-263. PMC: 7610550. DOI: 10.1038/s41583-020-0289-z. View

12.

Browning M, Carter C, Chatham C, Ouden H, Gillan C, Baker J . Realizing the Clinical Potential of Computational Psychiatry: Report From the Banbury Center Meeting, February 2019. Biol Psychiatry. 2020; 88(2):e5-e10. DOI: 10.1016/j.biopsych.2019.12.026. View

13.

Liu S, Dolan R, Heinz A . Translation of Computational Psychiatry in the Context of Addiction. JAMA Psychiatry. 2020; 77(11):1099-1100. DOI: 10.1001/jamapsychiatry.2020.1637. View

14.

Sebold M, Nebe S, Garbusow M, Guggenmos M, Schad D, Beck A . When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence. Biol Psychiatry. 2017; 82(11):847-856. DOI: 10.1016/j.biopsych.2017.04.019. View

15.

Gu X, Lohrenz T, Salas R, Baldwin P, Soltani A, Kirk U . Belief about Nicotine Modulates Subjective Craving and Insula Activity in Deprived Smokers. Front Psychiatry. 2016; 7:126. PMC: 4942468. DOI: 10.3389/fpsyt.2016.00126. View

16.

Verdejo-Garcia A, Alcazar-Corcoles M, Albein-Urios N . Neuropsychological Interventions for Decision-Making in Addiction: a Systematic Review. Neuropsychol Rev. 2018; 29(1):79-92. DOI: 10.1007/s11065-018-9384-6. View

17.

Redish A . Addiction as a computational process gone awry. Science. 2004; 306(5703):1944-7. DOI: 10.1126/science.1102384. View

18.

Wang X, Krystal J . Computational psychiatry. Neuron. 2014; 84(3):638-54. PMC: 4255477. DOI: 10.1016/j.neuron.2014.10.018. View

19.

Baker T, Zeighami Y, Dagher A, Holroyd C . Smoking Decisions: Altered Reinforcement Learning Signals Induced by Nicotine State. Nicotine Tob Res. 2018; 22(2):164-171. DOI: 10.1093/ntr/nty136. View

20.

Ahmed S . Individual decision-making in the causal pathway to addiction: contributions and limitations of rodent models. Pharmacol Biochem Behav. 2017; 164:22-31. DOI: 10.1016/j.pbb.2017.07.005. View