» Articles » PMID: 30608922

Locus Coeruleus Tracking of Prediction Errors Optimises Cognitive Flexibility: An Active Inference Model

Overview
Specialty Biology
Date 2019 Jan 5
PMID 30608922
Citations 42
Authors
Affiliations
Soon will be listed here.
Abstract

The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm 'explore/exploit' task and show that, if LC activity is considered to reflect the magnitude of high level 'state-action' prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error-reflected in LC firing and noradrenaline release-to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability.

Citing Articles

Electrophysiological recording during touchscreen-based behavioral assays in rodents: A platform for improving early-stage neuroscience drug discovery.

Carr G J Neurochem. 2024; 169(1):e16289.

PMID: 39680493 PMC: 11753410. DOI: 10.1111/jnc.16289.


Task-irrelevant stimuli reliably boost phasic pupil-linked arousal but do not affect decision formation.

Hebisch J, Ghassemieh A, Zhecheva E, Brouwer M, van Gaal S, Schwabe L Sci Rep. 2024; 14(1):28380.

PMID: 39551856 PMC: 11570621. DOI: 10.1038/s41598-024-78791-8.


The Many Roles of Precision in Action.

Limanowski J, Adams R, Kilner J, Parr T Entropy (Basel). 2024; 26(9).

PMID: 39330123 PMC: 11431491. DOI: 10.3390/e26090790.


Prediction error determines how memories are organized in the brain.

Kennedy N, Lee J, Killcross S, Westbrook R, Holmes N Elife. 2024; 13.

PMID: 39027985 PMC: 11259430. DOI: 10.7554/eLife.95849.


A Computational Model of Hopelessness and Active-Escape Bias in Suicidality.

Karvelis P, Diaconescu A Comput Psychiatr. 2024; 6(1):34-59.

PMID: 38774778 PMC: 11104346. DOI: 10.5334/cpsy.80.


References
1.
Jepma M, Nieuwenhuis S . Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory. J Cogn Neurosci. 2010; 23(7):1587-96. DOI: 10.1162/jocn.2010.21548. View

2.
Berridge C, Waterhouse B . The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Brain Res Rev. 2003; 42(1):33-84. DOI: 10.1016/s0165-0173(03)00143-7. View

3.
Nassar M, Rumsey K, Wilson R, Parikh K, Heasly B, Gold J . Rational regulation of learning dynamics by pupil-linked arousal systems. Nat Neurosci. 2012; 15(7):1040-6. PMC: 3386464. DOI: 10.1038/nn.3130. View

4.
Hurley L, Devilbiss D, Waterhouse B . A matter of focus: monoaminergic modulation of stimulus coding in mammalian sensory networks. Curr Opin Neurobiol. 2004; 14(4):488-95. DOI: 10.1016/j.conb.2004.06.007. View

5.
Behrens T, Woolrich M, Walton M, Rushworth M . Learning the value of information in an uncertain world. Nat Neurosci. 2007; 10(9):1214-21. DOI: 10.1038/nn1954. View