Probability Differently Modulating the Effects of Reward and Punishment on Visuomotor Adaptation

Overview

Journal Exp Brain Res

Specialty Neurology

Date 2017 Sep 10

PMID 28887626

Citations 20

Authors

Yanlong Song

Ann L Smiley-Oyen

Affiliations

Soon will be listed here.

Abstract

Recent human motor learning studies revealed that punishment seemingly accelerated motor learning but reward enhanced consolidation of motor memory. It is not evident how intrinsic properties of reward and punishment modulate the potentially dissociable effects of reward and punishment on motor learning and motor memory. It is also not clear what causes the dissociation of the effects of reward and punishment. By manipulating probability of distribution, a critical property of reward and punishment, the present study demonstrated that probability had distinct modulation on the effects of reward and punishment in adapting to a sudden visual rotation and consolidation of the adaptation memory. Specifically, two probabilities of monetary reward and punishment distribution, 50 and 100%, were applied during young adult participants adapting to a sudden visual rotation. Punishment and reward showed distinct effects on motor adaptation and motor memory. The group that received punishments in 100% of the adaptation trials adapted significantly faster than the other three groups, but the group that received rewards in 100% of the adaptation trials showed marked savings in re-adapting to the same rotation. In addition, the group that received punishments in 50% of the adaptation trials that were randomly selected also had savings in re-adapting to the same rotation. Sensitivity to sensory prediction error or difference in explicit process induced by reward and punishment may likely contribute to the distinct effects of reward and punishment.

Citing Articles

The effects of reward and punishment on the performance of ping-pong ball bouncing.

Yin C, Wang Y, Li B, Gao T Front Behav Neurosci. 2024; 18:1433649.

PMID: 38993267 PMC: 11236609. DOI: 10.3389/fnbeh.2024.1433649.

The effects of auditory consequences on visuomotor adaptation and motor memory.

Malagon G, Marigold D Exp Brain Res. 2024; 242(7):1697-1708.

PMID: 38806711 DOI: 10.1007/s00221-024-06850-7.

Reinforcement feedback impairs locomotor adaptation and retention.

Hill C, Sebastiao E, Barzi L, Wilson M, Wood T Front Behav Neurosci. 2024; 18:1388495.

PMID: 38720784 PMC: 11076767. DOI: 10.3389/fnbeh.2024.1388495.

Punishment Leads to Greater Sensorimotor Learning But Less Movement Variability Compared to Reward.

Roth A, Lokesh R, Tang J, Buggeln J, Smith C, Calalo J Neuroscience. 2024; 540:12-26.

PMID: 38220127 PMC: 10922623. DOI: 10.1016/j.neuroscience.2024.01.004.

The effect of combining punishment and reward can transfer to opposite motor learning.

Yin C, Gao T, Li B PLoS One. 2023; 18(4):e0282028.

PMID: 37036847 PMC: 10085010. DOI: 10.1371/journal.pone.0282028.

References

Crockett M, Clark L, Robbins T . Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J Neurosci. 2009; 29(38):11993-9. PMC: 2775933. DOI: 10.1523/JNEUROSCI.2513-09.2009. View

Nikooyan A, Ahmed A . Reward feedback accelerates motor learning. J Neurophysiol. 2014; 113(2):633-46. DOI: 10.1152/jn.00032.2014. View

Galea J, Mallia E, Rothwell J, Diedrichsen J . The dissociable effects of punishment and reward on motor learning. Nat Neurosci. 2015; 18(4):597-602. DOI: 10.1038/nn.3956. View

THORNDIKE E . A PROOF OF THE LAW OF EFFECT. Science. 1933; 77(1989):173-5. DOI: 10.1126/science.77.1989.173-a. View

Mazzoni P, Krakauer J . An implicit plan overrides an explicit strategy during visuomotor adaptation. J Neurosci. 2006; 26(14):3642-5. PMC: 6674132. DOI: 10.1523/JNEUROSCI.5317-05.2006. View

Shizgal P . Neural basis of utility estimation. Curr Opin Neurobiol. 1997; 7(2):198-208. DOI: 10.1016/s0959-4388(97)80008-6. View

Yeung S, Colagiuri B, Lovibond P, Colloca L . Partial reinforcement, extinction, and placebo analgesia. Pain. 2014; 155(6):1110-1117. PMC: 4025912. DOI: 10.1016/j.pain.2014.02.022. View

Haith A, Huberdeau D, Krakauer J . The influence of movement preparation time on the expression of visuomotor learning and savings. J Neurosci. 2015; 35(13):5109-17. PMC: 6705405. DOI: 10.1523/JNEUROSCI.3869-14.2015. View

Zarahn E, Weston G, Liang J, Mazzoni P, Krakauer J . Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient. J Neurophysiol. 2008; 100(5):2537-48. PMC: 2585408. DOI: 10.1152/jn.90529.2008. View

10.

Abe M, Schambra H, Wassermann E, Luckenbaugh D, Schweighofer N, Cohen L . Reward improves long-term retention of a motor memory through induction of offline memory gains. Curr Biol. 2011; 21(7):557-62. PMC: 3075334. DOI: 10.1016/j.cub.2011.02.030. View

11.

Wachter T, Lungu O, Liu T, Willingham D, Ashe J . Differential effect of reward and punishment on procedural learning. J Neurosci. 2009; 29(2):436-43. PMC: 2765863. DOI: 10.1523/JNEUROSCI.4132-08.2009. View

12.

JENKINS W, STANLEY Jr J . Partial reinforcement: a review and critique. Psychol Bull. 1950; 47(3):193-234. DOI: 10.1037/h0060772. View

13.

Dayan E, Averbeck B, Richmond B, Cohen L . Stochastic reinforcement benefits skill acquisition. Learn Mem. 2014; 21(3):140-2. PMC: 3929848. DOI: 10.1101/lm.032417.113. View

14.

Balliet D, Mulder L, Van Lange P . Reward, punishment, and cooperation: a meta-analysis. Psychol Bull. 2011; 137(4):594-615. DOI: 10.1037/a0023489. View

15.

Tseng Y, Diedrichsen J, Krakauer J, Shadmehr R, Bastian A . Sensory prediction errors drive cerebellum-dependent adaptation of reaching. J Neurophysiol. 2007; 98(1):54-62. DOI: 10.1152/jn.00266.2007. View

16.

Schlerf J, Ivry R, Diedrichsen J . Encoding of sensory prediction errors in the human cerebellum. J Neurosci. 2012; 32(14):4913-22. PMC: 4332713. DOI: 10.1523/JNEUROSCI.4504-11.2012. View

17.

van der Kooij K, Overvliet K . Rewarding imperfect motor performance reduces adaptive changes. Exp Brain Res. 2016; 234(6):1441-50. PMC: 4851704. DOI: 10.1007/s00221-015-4540-1. View

18.

Moulton E, Elman I, Pendse G, Schmahmann J, Becerra L, Borsook D . Aversion-related circuitry in the cerebellum: responses to noxious heat and unpleasant images. J Neurosci. 2011; 31(10):3795-804. PMC: 3063442. DOI: 10.1523/JNEUROSCI.6709-10.2011. View

19.

OLDFIELD R . The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971; 9(1):97-113. DOI: 10.1016/0028-3932(71)90067-4. View

20.

Shadmehr R, Smith M, Krakauer J . Error correction, sensory prediction, and adaptation in motor control. Annu Rev Neurosci. 2010; 33:89-108. DOI: 10.1146/annurev-neuro-060909-153135. View