Neural Dynamics of Audiovisual Synchrony and Asynchrony Perception in 6-month-old Infants

Overview

Journal Front Psychol

Date 2013 Jan 25

PMID 23346071

Citations 4

Authors

Franziska Kopp

Claudia Dietrich

Affiliations

Soon will be listed here.

Abstract

Young infants are sensitive to multisensory temporal synchrony relations, but the neural dynamics of temporal interactions between vision and audition in infancy are not well understood. We investigated audiovisual synchrony and asynchrony perception in 6-month-old infants using event-related brain potentials (ERP). In a prior behavioral experiment (n = 45), infants were habituated to an audiovisual synchronous stimulus and tested for recovery of interest by presenting an asynchronous test stimulus in which the visual stream was delayed with respect to the auditory stream by 400 ms. Infants who behaviorally discriminated the change in temporal alignment were included in further analyses. In the EEG experiment (final sample: n = 15), synchronous and asynchronous stimuli (visual delay of 400 ms) were presented in random order. Results show latency shifts in the auditory ERP components N1 and P2 as well as the infant ERP component Nc. Latencies in the asynchronous condition were significantly longer than in the synchronous condition. After video onset but preceding the auditory onset, amplitude modulations propagating from posterior to anterior sites and related to the Pb component of infants' ERP were observed. Results suggest temporal interactions between the two modalities. Specifically, they point to the significance of anticipatory visual motion for auditory processing, and indicate young infants' predictive capacities for audiovisual temporal synchrony relations.

Citing Articles

The extent of western lowland gorilla social relationships within and between groups.

Cooksey K, Funkhouser J, Sanz C, Marie Massamba J, Fabrice Ebombi T, Teberd P PLoS One. 2025; 20(1):e0316598.

PMID: 39854343 PMC: 11761170. DOI: 10.1371/journal.pone.0316598.

The Development of Cortical Responses to the Integration of Audiovisual Speech in Infancy.

Dopierala A, Lopez Perez D, Mercure E, Pluta A, Malinowska-Korczak A, Evans S Brain Topogr. 2023; 36(4):459-475.

PMID: 37171657 PMC: 10176292. DOI: 10.1007/s10548-023-00959-8.

Auditory Discrimination Elicited by Nonspeech and Speech Stimuli in Children With Congenital Hearing Loss.

Yang Y, Li Q, Xiao Y, Liu Y, Sun K, Li B J Speech Lang Hear Res. 2022; 65(10):3981-3995.

PMID: 36095326 PMC: 9927627. DOI: 10.1044/2022_JSLHR-22-00008.

Effects of multimodal synchrony on infant attention and heart rate during events with social and nonsocial stimuli.

Curtindale L, Bahrick L, Lickliter R, Colombo J J Exp Child Psychol. 2018; 178:283-294.

PMID: 30445204 PMC: 6980371. DOI: 10.1016/j.jecp.2018.10.006.

Audiovisual temporal fusion in 6-month-old infants.

Kopp F Dev Cogn Neurosci. 2014; 9:56-67.

PMID: 24525177 PMC: 6989763. DOI: 10.1016/j.dcn.2014.01.001.

References

Besle J, Fort A, Delpuech C, Giard M . Bimodal speech: early suppressive visual effects in human auditory cortex. Eur J Neurosci. 2004; 20(8):2225-34. PMC: 1885424. DOI: 10.1111/j.1460-9568.2004.03670.x. View

Webb S, Long J, Nelson C . A longitudinal investigation of visual event-related potentials in the first year of life. Dev Sci. 2005; 8(6):605-16. DOI: 10.1111/j.1467-7687.2005.00452.x. View

Karrer J, Karrer R, Bloom D, Chaney L, Davis R . Event-related brain potentials during an extended visual recognition memory task depict delayed development of cerebral inhibitory processes among 6-month-old infants with Down syndrome. Int J Psychophysiol. 1998; 29(2):167-200. DOI: 10.1016/s0167-8760(98)00015-4. View

Hay-McCutcheon M, Pisoni D, Hunt K . Audiovisual asynchrony detection and speech perception in hearing-impaired listeners with cochlear implants: a preliminary analysis. Int J Audiol. 2009; 48(6):321-33. PMC: 2782821. DOI: 10.1080/14992020802644871. View

Bahrick L . Increasing specificity in perceptual development: infants' detection of nested levels of multimodal stimulation. J Exp Child Psychol. 2001; 79(3):253-70. DOI: 10.1006/jecp.2000.2588. View

Flom R, Bahrick L . The development of infant discrimination of affect in multimodal and unimodal stimulation: The role of intersensory redundancy. Dev Psychol. 2007; 43(1):238-52. PMC: 2704007. DOI: 10.1037/0012-1649.43.1.238. View

Stekelenburg J, Vroomen J . Neural correlates of multisensory integration of ecologically valid audiovisual events. J Cogn Neurosci. 2007; 19(12):1964-73. DOI: 10.1162/jocn.2007.19.12.1964. View

Petrini K, Russell M, Pollick F . When knowing can replace seeing in audiovisual integration of actions. Cognition. 2009; 110(3):432-9. DOI: 10.1016/j.cognition.2008.11.015. View

Fort A, Delpuech C, Pernier J, Giard M . Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res Cogn Brain Res. 2002; 14(1):20-30. DOI: 10.1016/s0926-6410(02)00058-7. View

10.

Foxe J, Molholm S . Ten years at the Multisensory Forum: musings on the evolution of a field. Brain Topogr. 2009; 21(3-4):149-54. DOI: 10.1007/s10548-009-0102-9. View

11.

Lewkowicz D, Sowinski R, Place S . The decline of cross-species intersensory perception in human infants: underlying mechanisms and its developmental persistence. Brain Res. 2008; 1242:291-302. PMC: 2612707. DOI: 10.1016/j.brainres.2008.03.084. View

12.

Spence C, Squire S . Multisensory integration: maintaining the perception of synchrony. Curr Biol. 2003; 13(13):R519-21. DOI: 10.1016/s0960-9822(03)00445-7. View

13.

Vatakis A, Spence C . Audiovisual synchrony perception for music, speech, and object actions. Brain Res. 2006; 1111(1):134-42. DOI: 10.1016/j.brainres.2006.05.078. View

14.

Macaluso E, George N, Dolan R, Spence C, Driver J . Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage. 2004; 21(2):725-32. DOI: 10.1016/j.neuroimage.2003.09.049. View

15.

Dodd B . Lip reading in infants: attention to speech presented in- and out-of-synchrony. Cogn Psychol. 1979; 11(4):478-84. DOI: 10.1016/0010-0285(79)90021-5. View

16.

de Gelder B, Bertelson P . Multisensory integration, perception and ecological validity. Trends Cogn Sci. 2003; 7(10):460-7. DOI: 10.1016/j.tics.2003.08.014. View

17.

DIXON N, Spitz L . The detection of auditory visual desynchrony. Perception. 1980; 9(6):719-21. DOI: 10.1068/p090719. View

18.

Welch R, Warren D . Immediate perceptual response to intersensory discrepancy. Psychol Bull. 1980; 88(3):638-67. View

19.

Besle J, Bertrand O, Giard M . Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hear Res. 2009; 258(1-2):143-51. DOI: 10.1016/j.heares.2009.06.016. View

20.

Lewkowicz D, Leo I, Simion F . Intersensory Perception at Birth: Newborns Match Nonhuman Primate Faces and Voices. Infancy. 2020; 15(1):46-60. DOI: 10.1111/j.1532-7078.2009.00005.x. View