A Comparative Analysis of Response Times Shows That Multisensory Benefits and Interactions Are Not Equivalent
Authors
Affiliations
Multisensory signals allow faster responses than the unisensory components. While this redundant signals effect (RSE) has been studied widely with diverse signals, no modelling approach explored the RSE systematically across studies. For a comparative analysis, here, we propose three steps: The first quantifies the RSE compared to a simple, parameter-free race model. The second quantifies processing interactions beyond the race mechanism: history effects and so-called violations of Miller's bound. The third models the RSE on the level of response time distributions using a context-variant race model with two free parameters that account for the interactions. Mimicking the diversity of studies, we tested different audio-visual signals that target the interactions using a 2 × 2 design. We show that the simple race model provides overall a strong prediction of the RSE. Regarding interactions, we found that history effects do not depend on low-level feature repetition. Furthermore, violations of Miller's bound seem linked to transient signal onsets. Critically, the latter dissociates from the RSE, demonstrating that multisensory interactions and multisensory benefits are not equivalent. Overall, we argue that our approach, as a blueprint, provides both a general framework and the precision needed to understand the RSE when studied across diverse signals and participant groups.
Semantic congruency modulates the speed-up of multisensory responses.
Roberts K, Jentzsch I, Otto T Sci Rep. 2024; 14(1):567.
PMID: 38177170 PMC: 10766646. DOI: 10.1038/s41598-023-50674-4.
Resolution of impaired multisensory processing in autism and the cost of switching sensory modality.
Crosse M, Foxe J, Tarrit K, Freedman E, Molholm S Commun Biol. 2022; 5(1):601.
PMID: 35773473 PMC: 9246932. DOI: 10.1038/s42003-022-03519-1.
Robust perceptual-load-dependent audiovisual integration in adult ADHD.
Schulze M, Aslan B, Jung P, Lux S, Philipsen A Eur Arch Psychiatry Clin Neurosci. 2022; 272(8):1443-1451.
PMID: 35380238 PMC: 9653355. DOI: 10.1007/s00406-022-01401-z.
Multisensory integration attenuates visually induced oculomotor inhibition of return.
Tang X, Yuan M, Shi Z, Gao M, Ren R, Wei M J Vis. 2022; 22(4):7.
PMID: 35297999 PMC: 8944392. DOI: 10.1167/jov.22.4.7.
Barutchu A, Spence C Exp Brain Res. 2021; 239(3):1021-1034.
PMID: 33515085 PMC: 7943519. DOI: 10.1007/s00221-020-06014-3.