Automatic Imitation of Speech is Enhanced for Non-native Sounds

Overview

Journal Psychon Bull Rev

Specialty Psychology

Date 2023 Oct 17

PMID 37848661

Authors

Hannah Wilt

Yuchunzi Wu

Bronwen G Evans

Patti Adank

Affiliations

Soon will be listed here.

Abstract

Simulation accounts of speech perception posit that speech is covertly imitated to support perception in a top-down manner. Behaviourally, covert imitation is measured through the stimulus-response compatibility (SRC) task. In each trial of a speech SRC task, participants produce a target speech sound whilst perceiving a speech distractor that either matches the target (compatible condition) or does not (incompatible condition). The degree to which the distractor is covertly imitated is captured by the automatic imitation effect, computed as the difference in response times (RTs) between compatible and incompatible trials. Simulation accounts disagree on whether covert imitation is enhanced when speech perception is challenging or instead when the speech signal is most familiar to the speaker. To test these accounts, we conducted three experiments in which participants completed SRC tasks with native and non-native sounds. Experiment 1 uncovered larger automatic imitation effects in an SRC task with non-native sounds than with native sounds. Experiment 2 replicated the finding online, demonstrating its robustness and the applicability of speech SRC tasks online. Experiment 3 intermixed native and non-native sounds within a single SRC task to disentangle effects of perceiving non-native sounds from confounding effects of producing non-native speech actions. This last experiment confirmed that automatic imitation is enhanced for non-native speech distractors, supporting a compensatory function of covert imitation in speech perception. The experiment also uncovered a separate effect of producing non-native speech actions on enhancing automatic imitation effects.

References

Michaelis K, Miyakoshi M, Norato G, Medvedev A, Turkeltaub P . Motor engagement relates to accurate perception of phonemes and audiovisual words, but not auditory words. Commun Biol. 2021; 4(1):108. PMC: 7835217. DOI: 10.1038/s42003-020-01634-5. View

Kerzel D, Bekkering H . Motor activation from visible speech: evidence from stimulus response compatibility. J Exp Psychol Hum Percept Perform. 2000; 26(2):634-47. DOI: 10.1037//0096-1523.26.2.634. View

Nuttall H, Kennedy-Higgins D, Devlin J, Adank P . The role of hearing ability and speech distortion in the facilitation of articulatory motor cortex. Neuropsychologia. 2016; 94:13-22. DOI: 10.1016/j.neuropsychologia.2016.11.016. View

Wilson S, Iacoboni M . Neural responses to non-native phonemes varying in producibility: evidence for the sensorimotor nature of speech perception. Neuroimage. 2006; 33(1):316-25. DOI: 10.1016/j.neuroimage.2006.05.032. View

Heyes C, Bird G, Johnson H, Haggard P . Experience modulates automatic imitation. Brain Res Cogn Brain Res. 2005; 22(2):233-40. DOI: 10.1016/j.cogbrainres.2004.09.009. View

Murakami T, Restle J, Ziemann U . Observation-execution matching and action inhibition in human primary motor cortex during viewing of speech-related lip movements or listening to speech. Neuropsychologia. 2011; 49(7):2045-54. DOI: 10.1016/j.neuropsychologia.2011.03.034. View

Watkins K, Strafella A, Paus T . Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia. 2003; 41(8):989-94. DOI: 10.1016/s0028-3932(02)00316-0. View

Jarick M, Jones J . Effects of seeing and hearing speech on speech production: a response time study. Exp Brain Res. 2009; 195(2):175-82. DOI: 10.1007/s00221-009-1765-x. View

Woods K, Siegel M, Traer J, McDermott J . Headphone screening to facilitate web-based auditory experiments. Atten Percept Psychophys. 2017; 79(7):2064-2072. PMC: 5693749. DOI: 10.3758/s13414-017-1361-2. View

10.

Nuttall H, Kennedy-Higgins D, Hogan J, Devlin J, Adank P . The effect of speech distortion on the excitability of articulatory motor cortex. Neuroimage. 2016; 128:218-226. DOI: 10.1016/j.neuroimage.2015.12.038. View

11.

Calvo-Merino B, Glaser D, Grezes J, Passingham R, Haggard P . Action observation and acquired motor skills: an FMRI study with expert dancers. Cereb Cortex. 2004; 15(8):1243-9. DOI: 10.1093/cercor/bhi007. View

12.

Swaminathan S, MacSweeney M, Boyles R, Waters D, Watkins K, Mottonen R . Motor excitability during visual perception of known and unknown spoken languages. Brain Lang. 2013; 126(1):1-7. PMC: 3682190. DOI: 10.1016/j.bandl.2013.03.002. View

13.

Heyes C . Automatic imitation. Psychol Bull. 2011; 137(3):463-83. DOI: 10.1037/a0022288. View

14.

van Leeuwen M, van Baaren R, Martin D, Dijksterhuis A, Bekkering H . Executive functioning and imitation: Increasing working memory load facilitates behavioural imitation. Neuropsychologia. 2009; 47(14):3265-70. DOI: 10.1016/j.neuropsychologia.2009.06.005. View

15.

Pickering M, Gambi C . Predicting while comprehending language: A theory and review. Psychol Bull. 2018; 144(10):1002-1044. DOI: 10.1037/bul0000158. View

16.

Cook R, Press C, Dickinson A, Heyes C . Acquisition of automatic imitation is sensitive to sensorimotor contingency. J Exp Psychol Hum Percept Perform. 2010; 36(4):840-52. DOI: 10.1037/a0019256. View

17.

Fadiga L, Fogassi L, Pavesi G, Rizzolatti G . Motor facilitation during action observation: a magnetic stimulation study. J Neurophysiol. 1995; 73(6):2608-11. DOI: 10.1152/jn.1995.73.6.2608. View

18.

Feng C, Wang H, Lu N, Tu X . Log transformation: application and interpretation in biomedical research. Stat Med. 2012; 32(2):230-9. DOI: 10.1002/sim.5486. View

19.

Virhia J, Kotz S, Adank P . Emotional state dependence facilitates automatic imitation of visual speech. Q J Exp Psychol (Hove). 2019; 72(12):2833-2847. DOI: 10.1177/1747021819867856. View

20.

Ghaffarvand Mokari P, Gafos A, Williams D . Perceptuomotor compatibility effects in vowels: Effects of consonantal context and acoustic proximity of response and distractor. JASA Express Lett. 2022; 1(1):015204. DOI: 10.1121/10.0003039. View