Recovering Reliable Idiographic Biological Parameters from Noisy Behavioral Data: the Case of Basal Ganglia Indices in the Probabilistic Selection Task

Overview

Journal Comput Brain Behav

Date 2021 Mar 30

PMID 33782661

Citations 1

Authors

Yinan Xu

Andrea Stocco

Affiliations

Soon will be listed here.

Abstract

Behavioral data, despite being a common index of cognitive activity, is under scrutiny for having poor reliability as a result of noise or lacking replications of reliable effects. Here, we argue that cognitive modeling can be used to enhance the test-retest reliability of the behavioral measures by recovering individual-level parameters from behavioral data. We tested this empirically with the Probabilistic Stimulus Selection (PSS) task, which is used to measure a participant's sensitivity to positive or negative reinforcement. An analysis of 400,000 simulations from an Adaptive Control of Thought-Rational (ACT-R) model of this task showed that the poor reliability of the task is due to the instability of the end-estimates: because of the way the task works, the same participants might sometimes end up having apparently opposite scores. To recover the underlying interpretable parameters and enhance reliability, we used a Bayesian Maximum A Posteriori (MAP) procedure. We were able to obtain reliable parameters across sessions (intraclass correlation coefficient ≈ 0.5). A follow-up study on a modified version of the task also found the same pattern of results, with very poor test-retest reliability in behavior but moderate reliability in recovered parameters (intraclass correlation coefficient ≈ 0.4). Collectively, these results imply that this approach can further be used to provide superior measures in terms of reliability, and bring greater insights into individual differences.

Citing Articles

Intrinsic motivation in cognitive architecture: intellectual curiosity originated from pattern discovery.

Nagashima K, Morita J, Takeuchi Y Front Artif Intell. 2024; 7:1397860.

PMID: 39484152 PMC: 11525000. DOI: 10.3389/frai.2024.1397860.

References

Collins A, Frank M . Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychol Rev. 2014; 121(3):337-66. DOI: 10.1037/a0037015. View

Baker T, Stockwell T, Holroyd C . Constraints on decision making: implications from genetics, personality, and addiction. Cogn Affect Behav Neurosci. 2013; 13(3):417-36. DOI: 10.3758/s13415-013-0164-8. View

Collins A . The Tortoise and the Hare: Interactions between Reinforcement Learning and Working Memory. J Cogn Neurosci. 2018; 30(10):1422-1432. DOI: 10.1162/jocn_a_01238. View

Shrout P, Fleiss J . Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86(2):420-8. DOI: 10.1037//0033-2909.86.2.420. View

Maril S, Hassin-Baer S, Cohen O, Tomer R . Effects of asymmetric dopamine depletion on sensitivity to rewarding and aversive stimuli in Parkinson's disease. Neuropsychologia. 2013; 51(5):818-24. DOI: 10.1016/j.neuropsychologia.2013.02.003. View

Frank M, OReilly R, Curran T . When memory fails, intuition reigns: midazolam enhances implicit inference in humans. Psychol Sci. 2006; 17(8):700-7. DOI: 10.1111/j.1467-9280.2006.01769.x. View

White C, Congdon E, Mumford J, Karlsgodt K, Sabb F, Freimer N . Decomposing decision components in the stop-signal task: a model-based approach to individual differences in inhibitory control. J Cogn Neurosci. 2014; 26(8):1601-14. PMC: 4119005. DOI: 10.1162/jocn_a_00567. View

Mathar D, Neumann J, Villringer A, Horstmann A . Failing to learn from negative prediction errors: Obesity is associated with alterations in a fundamental neural learning mechanism. Cortex. 2017; 95:222-237. DOI: 10.1016/j.cortex.2017.08.022. View

Djamshidian A, Jha A, OSullivan S, Silveira-Moriyama L, Jacobson C, Brown P . Risk and learning in impulsive and nonimpulsive patients with Parkinson's disease. Mov Disord. 2010; 25(13):2203-10. PMC: 3093055. DOI: 10.1002/mds.23247. View

10.

Waltz J, Frank M, Robinson B, Gold J . Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol Psychiatry. 2007; 62(7):756-64. PMC: 2083701. DOI: 10.1016/j.biopsych.2006.09.042. View

11.

Stocco A . A Biologically Plausible Action Selection System for Cognitive Architectures: Implications of Basal Ganglia Anatomy for Learning and Decision-Making Models. Cogn Sci. 2017; 42(2):457-490. DOI: 10.1111/cogs.12506. View

12.

Anderson J . Human symbol manipulation within an integrated cognitive architecture. Cogn Sci. 2011; 29(3):313-41. DOI: 10.1207/s15516709cog0000_22. View

13.

Schutte I, Slagter H, Collins A, Frank M, Kenemans J . Stimulus discriminability may bias value-based probabilistic learning. PLoS One. 2017; 12(5):e0176205. PMC: 5421749. DOI: 10.1371/journal.pone.0176205. View

14.

Gerfen C, Engber T, Mahan L, Susel Z, Chase T, Monsma Jr F . D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science. 1990; 250(4986):1429-32. DOI: 10.1126/science.2147780. View

15.

Albin R, Young A, Penney J . The functional anatomy of basal ganglia disorders. Trends Neurosci. 1989; 12(10):366-75. DOI: 10.1016/0166-2236(89)90074-x. View

16.

. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. 2015; 349(6251):aac4716. DOI: 10.1126/science.aac4716. View

17.

Grogan J, Tsivos D, Smith L, Knight B, Bogacz R, Whone A . Effects of dopamine on reinforcement learning and consolidation in Parkinson's disease. Elife. 2017; 6. PMC: 5531832. DOI: 10.7554/eLife.26801. View

18.

Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, Pessiglione M . Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc Natl Acad Sci U S A. 2009; 106(45):19179-84. PMC: 2776465. DOI: 10.1073/pnas.0904035106. View

19.

Frank M, Samanta J, Moustafa A, Sherman S . Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science. 2007; 318(5854):1309-12. DOI: 10.1126/science.1146157. View

20.

Pessiglione M, Seymour B, Flandin G, Dolan R, Frith C . Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006; 442(7106):1042-5. PMC: 2636869. DOI: 10.1038/nature05051. View