Multisensory Integration is Independent of Perceived Simultaneity
Overview
Affiliations
The importance of multisensory integration for perception and action has long been recognised. Integrating information from individual senses increases the chance of survival by reducing the variability in the incoming signals, thus allowing us to respond more rapidly. Reaction times (RTs) are fastest when the components of the multisensory signals are simultaneous. This response facilitation is traditionally attributed to multisensory integration. However, it is unclear if facilitation of RTs occurs when stimuli are perceived as synchronous or are actually physically synchronous. Repeated exposure to audiovisual asynchrony can change the delay at which multisensory stimuli are perceived as simultaneous, thus changing the delay at which the stimuli are integrated-perceptually. Here we set out to determine how such changes in multisensory integration for perception affect our ability to respond to multisensory events. If stimuli perceived as simultaneous were reacted to most rapidly, it would suggest a common system for multisensory integration for perception and action. If not, it would suggest separate systems. We measured RTs to auditory, visual, and audiovisual stimuli following exposure to audiovisual asynchrony. Exposure affected the variability of the unisensory RT distributions; in particular, the slowest RTs were either speed up or slowed down (in the direction predicted from shifts in perceived simultaneity). Additionally, the multisensory facilitation of RTs (beyond statistical summation) only occurred when audiovisual onsets were physically synchronous, rather than when they appeared simultaneous. We conclude that the perception of synchrony is therefore independent of multisensory integration and suggest a division between multisensory processes that are fast (automatic and unaffected by temporal adaptation) and those that are slow (perceptually driven and adaptable).
Automatic multisensory integration follows subjective confidence rather than objective performance.
Gao Y, Xue K, Odegaard B, Rahnev D Commun Psychol. 2025; 3(1):38.
PMID: 40069314 PMC: 11896883. DOI: 10.1038/s44271-025-00221-w.
Visual modulation of auditory evoked potentials in the cat.
Bao X, Lomber S Sci Rep. 2024; 14(1):7177.
PMID: 38531940 PMC: 10965913. DOI: 10.1038/s41598-024-57075-1.
Audiovisual simultaneity windows reflect temporal sensory uncertainty.
Cary E, Lahdesmaki I, Badde S Psychon Bull Rev. 2024; 31(5):2170-2179.
PMID: 38388825 PMC: 11543760. DOI: 10.3758/s13423-024-02478-4.
Temporal order judgment of multisensory stimuli in rat and human.
Mafi F, Tang M, Afarinesh M, Ghasemian S, Sheibani V, Arabzadeh E Front Behav Neurosci. 2023; 16:1070452.
PMID: 36710957 PMC: 9879721. DOI: 10.3389/fnbeh.2022.1070452.
Musical training refines audiovisual integration but does not influence temporal recalibration.
ODonohue M, Lacherez P, Yamamoto N Sci Rep. 2022; 12(1):15292.
PMID: 36097277 PMC: 9468170. DOI: 10.1038/s41598-022-19665-9.