Different Aspects of Performance Feedback Engage Different Brain Areas: Disentangling Valence and Expectancy in Feedback Processing

Overview

Journal Sci Rep

Specialty Science

Date 2014 Aug 8

PMID 25100234

Citations 18

Authors

Nicola K Ferdinand

Bertram Opitz

Affiliations

Soon will be listed here.

Abstract

Evaluating the positive and negative outcomes of our behaviour is important for action selection and learning. Such reinforcement learning has been shown to engage a specific neural circuitry including the mesencephalic dopamine system and its target areas, the striatum and medial frontal cortex, especially the anterior cingulate cortex (ACC). An intensively pursued debate regards the prevailing influence of feedback expectancy and feedback valence on the engagement of these two brain regions in reinforcement learning and their respective roles are far from being understood. To this end, we used a time estimation task with three different types of feedback that allows disentangling the effect of feedback valence and expectancy using functional magnetic resonance imaging (fMRI). Our results show greater ACC activation after unexpected positive and unexpected negative feedback than after expected feedback and by this sensitivity to unexpected events in general irrespective of their valence.

Citing Articles

Get out of my head: social evaluative brain states carry over into post-feedback rest and influence remembering how others view us.

Brietzke S, Barbarossa K, Meyer M Cereb Cortex. 2024; 34(7.

PMID: 39010819 PMC: 11250231. DOI: 10.1093/cercor/bhae280.

The Role of the Human Cerebellum for Learning from and Processing of External Feedback in Non-Motor Learning: A Systematic Review.

Berlijn A, Huvermann D, Schneider S, Bellebaum C, Timmann D, Minnerop M Cerebellum. 2024; 23(4):1532-1551.

PMID: 38379034 PMC: 11269477. DOI: 10.1007/s12311-024-01669-y.

The contribution of theta and delta to feedback processing in children with developmental language disorder.

Gul A, Baron L, Arbel Y J Neurodev Disord. 2023; 15(1):13.

PMID: 37069567 PMC: 10108548. DOI: 10.1186/s11689-023-09481-1.

Learning With and Without Feedback in Children With Developmental Language Disorder.

Arbel Y, Fitzpatrick I, He X J Speech Lang Hear Res. 2021; 64(5):1696-1711.

PMID: 33877883 PMC: 8608225. DOI: 10.1044/2021_JSLHR-20-00499.

Electrophysiological Examination of Feedback-Based Learning in 8-11-Year-Old Children.

Arbel Y, Fox A Front Psychol. 2021; 12:640270.

PMID: 33716909 PMC: 7947233. DOI: 10.3389/fpsyg.2021.640270.

References

Mies G, van der Molen M, Smits M, Hengeveld M, van der Veen F . The anterior cingulate cortex responds differently to the validity and valence of feedback in a time-estimation task. Neuroimage. 2011; 56(4):2321-8. DOI: 10.1016/j.neuroimage.2011.04.015. View

van Veen V, Holroyd C, Cohen J, Stenger V, Carter C . Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn. 2004; 56(2):267-76. DOI: 10.1016/j.bandc.2004.06.007. View

Kahnt T, Park S, Cohen M, Beck A, Heinz A, Wrase J . Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J Cogn Neurosci. 2008; 21(7):1332-45. DOI: 10.1162/jocn.2009.21092. View

Koch K, Schachtzabel C, Wagner G, Reichenbach J, Sauer H, Schlosser R . The neural correlates of reward-related trial-and-error learning: an fMRI study with a probabilistic learning task. Learn Mem. 2008; 15(10):728-32. DOI: 10.1101/lm.1106408. View

Alexander W, Brown J . Computational models of performance monitoring and cognitive control. Top Cogn Sci. 2011; 2(4):658-77. PMC: 3044326. DOI: 10.1111/j.1756-8765.2010.01085.x. View

Jessup R, Busemeyer J, Brown J . Error effects in anterior cingulate cortex reverse when error likelihood is high. J Neurosci. 2010; 30(9):3467-72. PMC: 2841347. DOI: 10.1523/JNEUROSCI.4130-09.2010. View

Becker M, Nitsch A, Miltner W, Straube T . A single-trial estimation of the feedback-related negativity and its relation to BOLD responses in a time-estimation task. J Neurosci. 2014; 34(8):3005-12. PMC: 6608516. DOI: 10.1523/JNEUROSCI.3684-13.2014. View

Ridderinkhof K, Ullsperger M, Crone E, Nieuwenhuis S . The role of the medial frontal cortex in cognitive control. Science. 2004; 306(5695):443-7. DOI: 10.1126/science.1100301. View

Luu P, Tucker D, Derryberry D, Reed M, Poulsen C . Electrophysiological responses to errors and feedback in the process of action regulation. Psychol Sci. 2003; 14(1):47-53. DOI: 10.1111/1467-9280.01417. View

10.

Nieuwenhuis S, Slagter H, von Geusau N, Heslenfeld D, Holroyd C . Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur J Neurosci. 2005; 21(11):3161-8. DOI: 10.1111/j.1460-9568.2005.04152.x. View

11.

Haruno M, Kawato M . Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J Neurophysiol. 2005; 95(2):948-59. DOI: 10.1152/jn.00382.2005. View

12.

Zink C, Pagnoni G, Martin-Skurski M, Chappelow J, Berns G . Human striatal responses to monetary reward depend on saliency. Neuron. 2004; 42(3):509-17. DOI: 10.1016/s0896-6273(04)00183-7. View

13.

Aarts E, Roelofs A, van Turennout M . Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J Neurosci. 2008; 28(18):4671-8. PMC: 6670453. DOI: 10.1523/JNEUROSCI.4400-07.2008. View

14.

van der Veen F, Roder C, Mies G, van der Lugt A, Smits M . Remedial action and feedback processing in a time-estimation task: evidence for a role of the rostral cingulate zone in behavioral adjustments without learning. Neuroimage. 2010; 54(1):447-54. DOI: 10.1016/j.neuroimage.2010.08.018. View

15.

Donkers F, Nieuwenhuis S, van Boxtel G . Mediofrontal negativities in the absence of responding. Brain Res Cogn Brain Res. 2005; 25(3):777-87. DOI: 10.1016/j.cogbrainres.2005.09.007. View

16.

Amiez C, Sallet J, Procyk E, Petrides M . Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration. Neuroimage. 2012; 63(3):1078-90. DOI: 10.1016/j.neuroimage.2012.06.023. View

17.

Ullsperger M, von Cramon D . Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci. 2003; 23(10):4308-14. PMC: 6741115. View

18.

Holroyd C, Nieuwenhuis S, Yeung N, Cohen J . Errors in reward prediction are reflected in the event-related brain potential. Neuroreport. 2003; 14(18):2481-4. DOI: 10.1097/00001756-200312190-00037. View

19.

Critchley H . Neural mechanisms of autonomic, affective, and cognitive integration. J Comp Neurol. 2005; 493(1):154-66. DOI: 10.1002/cne.20749. View

20.

Daniel R, Pollmann S . Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning. J Neurosci. 2010; 30(1):47-55. PMC: 6632509. DOI: 10.1523/JNEUROSCI.2205-09.2010. View