Speech and Non-speech Audio-visual Illusions: a Developmental Study

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2007 Aug 22

PMID 17710142

Citations 46

Authors

Corinne Tremblay

Francois Champoux

Patrice Voss

Benoit A Bacon

Franco Lepore

Hugo Theoret

Affiliations

Soon will be listed here.

Abstract

It is well known that simultaneous presentation of incongruent audio and visual stimuli can lead to illusory percepts. Recent data suggest that distinct processes underlie non-specific intersensory speech as opposed to non-speech perception. However, the development of both speech and non-speech intersensory perception across childhood and adolescence remains poorly defined. Thirty-eight observers aged 5 to 19 were tested on the McGurk effect (an audio-visual illusion involving speech), the Illusory Flash effect and the Fusion effect (two audio-visual illusions not involving speech) to investigate the development of audio-visual interactions and contrast speech vs. non-speech developmental patterns. Whereas the strength of audio-visual speech illusions varied as a direct function of maturational level, performance on non-speech illusory tasks appeared to be homogeneous across all ages. These data support the existence of independent maturational processes underlying speech and non-speech audio-visual illusory effects.

Citing Articles

Perception of the McGurk effect in people with one eye depends on whether the eye is removed during infancy or adulthood.

Moro S, Qureshi F, Steeves J Front Neurosci. 2023; 17:1217831.

PMID: 37901426 PMC: 10603249. DOI: 10.3389/fnins.2023.1217831.

Visually biased Perception in Cochlear Implant Users: A Study of the McGurk and Sound-Induced Flash Illusions.

Butera I, Stevenson R, Gifford R, Wallace M Trends Hear. 2023; 27:23312165221076681.

PMID: 37377212 PMC: 10334005. DOI: 10.1177/23312165221076681.

The McGurk Illusion: A Default Mechanism of the Auditory System.

Iqbal Z, Shahin A, Bortfeld H, Backer K Brain Sci. 2023; 13(3).

PMID: 36979322 PMC: 10046462. DOI: 10.3390/brainsci13030510.

The Impact of Singing on Visual and Multisensory Speech Perception in Children on the Autism Spectrum.

Feldman J, Tu A, Conrad J, Kuang W, Santapuram P, Woynaroski T Multisens Res. 2023; 36(1):57-74.

PMID: 36731528 PMC: 9924934. DOI: 10.1163/22134808-bja10087.

The development of speechreading skills in Chinese students with hearing impairment.

Zhang F, Lei J, Gong H, Wu H, Chen L Front Psychol. 2022; 13:1020211.

PMID: 36405128 PMC: 9674306. DOI: 10.3389/fpsyg.2022.1020211.

References

Calvert G, Campbell R, Brammer M . Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 2000; 10(11):649-57. DOI: 10.1016/s0960-9822(00)00513-3. View

Champoux F, Tremblay C, Mercier C, Lassonde M, Lepore F, Gagne J . A role for the inferior colliculus in multisensory speech integration. Neuroreport. 2006; 17(15):1607-10. DOI: 10.1097/01.wnr.0000236856.93586.94. View

Shams L, Kamitani Y, Shimojo S . Illusions. What you see is what you hear. Nature. 2000; 408(6814):788. DOI: 10.1038/35048669. View

Shimojo S, Shams L . Sensory modalities are not separate modalities: plasticity and interactions. Curr Opin Neurobiol. 2001; 11(4):505-9. DOI: 10.1016/s0959-4388(00)00241-5. View

Calvert G . Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 2001; 11(12):1110-23. DOI: 10.1093/cercor/11.12.1110. View

Shams L, Kamitani Y, Thompson S, Shimojo S . Sound alters visual evoked potentials in humans. Neuroreport. 2001; 12(17):3849-52. DOI: 10.1097/00001756-200112040-00049. View

Colin C, Radeau M, Soquet A, Demolin D, Colin F, Deltenre P . Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory. Clin Neurophysiol. 2002; 113(4):495-506. DOI: 10.1016/s1388-2457(02)00024-x. View

Lewkowicz D . Heterogeneity and heterochrony in the development of intersensory perception. Brain Res Cogn Brain Res. 2002; 14(1):41-63. DOI: 10.1016/s0926-6410(02)00060-5. View

Teder-Salejarvi W, McDonald J, Di Russo F, Hillyard S . An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res. 2002; 14(1):106-14. DOI: 10.1016/s0926-6410(02)00065-4. View

10.

Shams L, Kamitani Y, Shimojo S . Visual illusion induced by sound. Brain Res Cogn Brain Res. 2002; 14(1):147-52. DOI: 10.1016/s0926-6410(02)00069-1. View

11.

Frassinetti F, Bolognini N, Ladavas E . Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res. 2002; 147(3):332-43. DOI: 10.1007/s00221-002-1262-y. View

12.

Macaluso E, George N, Dolan R, Spence C, Driver J . Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage. 2004; 21(2):725-32. DOI: 10.1016/j.neuroimage.2003.09.049. View

13.

Andersen T, Tiippana K, Sams M . Factors influencing audiovisual fission and fusion illusions. Brain Res Cogn Brain Res. 2004; 21(3):301-8. DOI: 10.1016/j.cogbrainres.2004.06.004. View

14.

McGurk H, Macdonald J . Hearing lips and seeing voices. Nature. 1976; 264(5588):746-8. DOI: 10.1038/264746a0. View

15.

Welch R, Warren D . Immediate perceptual response to intersensory discrepancy. Psychol Bull. 1980; 88(3):638-67. View

16.

Massaro D . Children's perception of visual and auditory speech. Child Dev. 1984; 55(5):1777-88. View

17.

Massaro D, Thompson L, Barron B, Laren E . Developmental changes in visual and auditory contributions to speech perception. J Exp Child Psychol. 1986; 41(1):93-113. DOI: 10.1016/0022-0965(86)90053-6. View

18.

Dekle D, Fowler C, Funnell M . Audiovisual integration in perception of real words. Percept Psychophys. 1992; 51(4):355-62. DOI: 10.3758/bf03211629. View

19.

Rosenblum L, Saldana H . An audiovisual test of kinematic primitives for visual speech perception. J Exp Psychol Hum Percept Perform. 1996; 22(2):318-31. DOI: 10.1037//0096-1523.22.2.318. View

20.

Sekuler R, Sekuler A, Lau R . Sound alters visual motion perception. Nature. 1997; 385(6614):308. DOI: 10.1038/385308a0. View