Seeing Speech Affects Acoustic Information Processing in the Human Brainstem

Overview

Journal Exp Brain Res

Specialty Neurology

Date 2005 Oct 12

PMID 16217645

Citations 31

Authors

Gabriella Musacchia

Mikko Sams

Trent Nicol

Nina Kraus

Affiliations

Soon will be listed here.

Abstract

Afferent auditory processing in the human brainstem is often assumed to be determined by acoustic stimulus features alone and immune to stimulation by other senses or cognitive factors. In contrast, we show that lipreading during speech perception influences early acoustic processing. Event-related brainstem potentials were recorded from ten healthy adults to concordant (acoustic-visual match), conflicting (acoustic-visual mismatch) and unimodal stimuli. Audiovisual (AV) interactions occurred as early as approximately 11 ms post-acoustic stimulation and persisted for the first 30 ms of the response. Furthermore, the magnitude of interaction depended on AV pairings. These findings indicate considerable plasticity in early auditory processing.

Citing Articles

Multisensory and lexical information in speech perception.

Dorsi J, Lacey S, Sathian K Front Hum Neurosci. 2024; 17:1331129.

PMID: 38259332 PMC: 10800662. DOI: 10.3389/fnhum.2023.1331129.

Alterations of Audiovisual Integration in Alzheimer's Disease.

Liu Y, Wang Z, Wei T, Zhou S, Yin Y, Mi Y Neurosci Bull. 2023; 39(12):1859-1872.

PMID: 37812301 PMC: 10661680. DOI: 10.1007/s12264-023-01125-7.

Semantic priming from McGurk words: Priming depends on perception.

Dorsi J, Ostrand R, Rosenblum L Atten Percept Psychophys. 2023; 85(4):1219-1237.

PMID: 37155085 DOI: 10.3758/s13414-023-02689-2.

Early auditory cortical processing predicts auditory speech in noise identification and lipreading.

Dias J, McClaskey C, Harris K Neuropsychologia. 2021; 161:108012.

PMID: 34474065 PMC: 8487996. DOI: 10.1016/j.neuropsychologia.2021.108012.

Cross-modal effects in speech perception.

Keough M, Derrick D, Gick B Annu Rev Linguist. 2021; 5(1):49-66.

PMID: 34307767 PMC: 8297790. DOI: 10.1146/annurev-linguistics-011718-012353.

References

Moller A . Neural mechanisms of BAEP. Electroencephalogr Clin Neurophysiol Suppl. 1999; 49:27-35. View

Moller A . Diagnosis of acoustic tumors. Am J Otol. 2000; 21(1):151-2. View

Calvert G, Campbell R, Brammer M . Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 2000; 10(11):649-57. DOI: 10.1016/s0960-9822(00)00513-3. View

Binder J, Frost J, Hammeke T, Bellgowan P, Springer J, Kaufman J . Human temporal lobe activation by speech and nonspeech sounds. Cereb Cortex. 2000; 10(5):512-28. DOI: 10.1093/cercor/10.5.512. View

McDonald J, Teder-Salejarvi W, Hillyard S . Involuntary orienting to sound improves visual perception. Nature. 2000; 407(6806):906-8. DOI: 10.1038/35038085. View

Bushara K, Grafman J, Hallett M . Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci. 2001; 21(1):300-4. PMC: 6762435. View

Callan D, Callan A, Kroos C, Vatikiotis-Bateson E . Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Brain Res Cogn Brain Res. 2001; 10(3):349-53. DOI: 10.1016/s0926-6410(00)00054-9. View

McDonald J, Ward L . Involuntary listening aids seeing: evidence from human electrophysiology. Psychol Sci. 2001; 11(2):167-71. DOI: 10.1111/1467-9280.00233. View

Cunningham J, Nicol T, Zecker S, Bradlow A, Kraus N . Neurobiologic responses to speech in noise in children with learning problems: deficits and strategies for improvement. Clin Neurophysiol. 2001; 112(5):758-67. DOI: 10.1016/s1388-2457(01)00465-5. View

10.

Grant K . The effect of speechreading on masked detection thresholds for filtered speech. J Acoust Soc Am. 2001; 109(5 Pt 1):2272-5. DOI: 10.1121/1.1362687. View

11.

Calvert G . Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 2001; 11(12):1110-23. DOI: 10.1093/cercor/11.12.1110. View

12.

Hyde P, Knudsen E . The optic tectum controls visually guided adaptive plasticity in the owl's auditory space map. Nature. 2002; 415(6867):73-6. DOI: 10.1038/415073a. View

13.

King C, Warrier C, Hayes E, Kraus N . Deficits in auditory brainstem pathway encoding of speech sounds in children with learning problems. Neurosci Lett. 2002; 319(2):111-5. DOI: 10.1016/s0304-3940(01)02556-3. View

14.

Mottonen R, Krause C, Tiippana K, Sams M . Processing of changes in visual speech in the human auditory cortex. Brain Res Cogn Brain Res. 2002; 13(3):417-25. DOI: 10.1016/s0926-6410(02)00053-8. View

15.

Molholm S, Ritter W, Murray M, Javitt D, Schroeder C, Foxe J . Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res. 2002; 14(1):115-28. DOI: 10.1016/s0926-6410(02)00066-6. View

16.

Stein B, Wallace M, Stanford T, Jiang W . Cortex governs multisensory integration in the midbrain. Neuroscientist. 2002; 8(4):306-14. DOI: 10.1177/107385840200800406. View

17.

Gutfreund Y, Zheng W, Knudsen E . Gated visual input to the central auditory system. Science. 2002; 297(5586):1556-9. DOI: 10.1126/science.1073712. View

18.

Fort A, Delpuech C, Pernier J, Giard M . Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex. 2002; 12(10):1031-9. DOI: 10.1093/cercor/12.10.1031. View

19.

Hauser M, Chomsky N, Fitch W . The faculty of language: what is it, who has it, and how did it evolve?. Science. 2002; 298(5598):1569-79. DOI: 10.1126/science.298.5598.1569. View

20.

Zambarbieri D . The latency of saccades toward auditory targets in humans. Prog Brain Res. 2003; 140:51-9. DOI: 10.1016/S0079-6123(02)40041-6. View