Modality Switching in a Property Verification Task: An ERP Study of What Happens When Candles Flicker After High Heels Click

Overview

Journal Front Psychol

Date 2011 Jun 30

PMID 21713128

Citations 9

Authors

Jennifer Collins

Diane Pecher

Rene Zeelenberg

Seana Coulson

Affiliations

Soon will be listed here.

Abstract

The perceptual modalities associated with property words, such as flicker or click, have previously been demonstrated to affect subsequent property verification judgments (Pecher et al., 2003). Known as the conceptual modality switch effect, this finding supports the claim that brain systems for perception and action help subserve the representation of concepts. The present study addressed the cognitive and neural substrate of this effect by recording event-related potentials (ERPs) as participants performed a property verification task with visual or auditory properties in key trials. We found that for visual property verifications, modality switching was associated with an increased amplitude N400. For auditory verifications, switching led to a larger late positive complex. Observed ERP effects of modality switching suggest property words access perceptual brain systems. Moreover, the timing and pattern of the effects suggest perceptual systems impact the decision-making stage in the verification of auditory properties, and the semantic stage in the verification of visual properties.

Citing Articles

The cross-linguistic comparison of perceptual strength norms for Korean, English and L2 English.

Lee J, Shin J Front Psychol. 2023; 14:1188909.

PMID: 37538997 PMC: 10395129. DOI: 10.3389/fpsyg.2023.1188909.

The Multilevel Modality-Switch Effect: What Happens When We See the Bees Buzzing and Hear the Diamonds Glistening.

Scerrati E, Lugli L, Nicoletti R, Borghi A Psychon Bull Rev. 2016; 24(3):798-803.

PMID: 27542801 DOI: 10.3758/s13423-016-1150-2.

The role of sensory-motor modality compatibility in language processing.

Schaeffner S, Koch I, Philipp A Psychol Res. 2015; 80(2):212-23.

PMID: 25813198 DOI: 10.1007/s00426-015-0661-1.

How vertical hand movements impact brain activity elicited by literally and metaphorically related words: an ERP study of embodied metaphor.

Bardolph M, Coulson S Front Hum Neurosci. 2015; 8:1031.

PMID: 25566041 PMC: 4274969. DOI: 10.3389/fnhum.2014.01031.

N400 ERPs for actions: building meaning in context.

Amoruso L, Gelormini C, Aboitiz F, Alvarez Gonzalez M, Manes F, Cardona J Front Hum Neurosci. 2013; 7:57.

PMID: 23459873 PMC: 3586681. DOI: 10.3389/fnhum.2013.00057.

References

Lynott D, Connell L . Modality exclusivity norms for 423 object properties. Behav Res Methods. 2009; 41(2):558-64. DOI: 10.3758/BRM.41.2.558. View

Gondan M, Lange K, Rosler F, Roder B . The redundant target effect is affected by modality switch costs. Psychon Bull Rev. 2004; 11(2):307-13. DOI: 10.3758/bf03196575. View

Comerchero M, Polich J . P3a and P3b from typical auditory and visual stimuli. Clin Neurophysiol. 1999; 110(1):24-30. DOI: 10.1016/s0168-5597(98)00033-1. View

Kellenbach M, Wijers A, Mulder G . Visual semantic features are activated during the processing of concrete words: event-related potential evidence for perceptual semantic priming. Brain Res Cogn Brain Res. 2000; 10(1-2):67-75. DOI: 10.1016/s0926-6410(00)00023-9. View

Polich J . Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol. 2007; 118(10):2128-48. PMC: 2715154. DOI: 10.1016/j.clinph.2007.04.019. View

Bentin S . Event-related potentials, semantic processes, and expectancy factors in word recognition. Brain Lang. 1987; 31(2):308-27. DOI: 10.1016/0093-934x(87)90077-0. View

Hagoort P . The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philos Trans R Soc Lond B Biol Sci. 2007; 363(1493):1055-69. PMC: 2606796. DOI: 10.1098/rstb.2007.2159. View

Goldberg R, Perfetti C, Schneider W . Perceptual knowledge retrieval activates sensory brain regions. J Neurosci. 2006; 26(18):4917-21. PMC: 6674166. DOI: 10.1523/JNEUROSCI.5389-05.2006. View

Urbach T, Kutas M . The intractability of scaling scalp distributions to infer neuroelectric sources. Psychophysiology. 2002; 39(6):791-808. DOI: 10.1111/1469-8986.3960791. View

10.

Pecher D, Zeelenberg R, Barsalou L . Sensorimotor simulations underlie conceptual representations: modality-specific effects of prior activation. Psychon Bull Rev. 2004; 11(1):164-7. DOI: 10.3758/bf03206477. View

11.

Kutas M, Federmeier K . Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu Rev Psychol. 2010; 62:621-47. PMC: 4052444. DOI: 10.1146/annurev.psych.093008.131123. View

12.

Barsalou L . Perceptual symbol systems. Behav Brain Sci. 2001; 22(4):577-609; discussion 610-60. DOI: 10.1017/s0140525x99002149. View

13.

Regel S, Coulson S, Gunter T . The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony. Brain Res. 2009; 1311:121-35. DOI: 10.1016/j.brainres.2009.10.077. View

14.

Barsalou L . Grounded cognition. Annu Rev Psychol. 2007; 59:617-45. DOI: 10.1146/annurev.psych.59.103006.093639. View

15.

Smith M, Halgren E . Dissociation of recognition memory components following temporal lobe lesions. J Exp Psychol Learn Mem Cogn. 1989; 15(1):50-60. DOI: 10.1037//0278-7393.15.1.50. View

16.

Holcomb P . Automatic and attentional processing: an event-related brain potential analysis of semantic priming. Brain Lang. 1988; 35(1):66-85. DOI: 10.1016/0093-934x(88)90101-0. View

17.

van Dantzig S, Pecher D, Zeelenberg R, Barsalou L . Perceptual processing affects conceptual processing. Cogn Sci. 2011; 32(3):579-90. DOI: 10.1080/03640210802035365. View

18.

Martin A . The representation of object concepts in the brain. Annu Rev Psychol. 2006; 58:25-45. DOI: 10.1146/annurev.psych.57.102904.190143. View

19.

Spence C, Nicholls M, Driver J . The cost of expecting events in the wrong sensory modality. Percept Psychophys. 2001; 63(2):330-6. DOI: 10.3758/bf03194473. View

20.

Lau E, Phillips C, Poeppel D . A cortical network for semantics: (de)constructing the N400. Nat Rev Neurosci. 2008; 9(12):920-33. DOI: 10.1038/nrn2532. View