Optimal Integration of Actions and Their Visual Effects is Based on Both Online and Prior Causality Evidence
Authors
Affiliations
The brain needs to identify redundant sensory signals in order to integrate them optimally. The identification process, referred to as causal inference, depends on the spatial and temporal correspondence of the incoming sensory signals ('online sensory causality evidence') as well as on prior expectations regarding their causal relation. We here examine whether the same causal inference process underlies spatial integration of actions and their visual consequences. We used a basic cursor-control task for which online sensory causality evidence is provided by the correlated hand and cursor movements, and prior expectations are formed by everyday experience of such correlated movements. Participants made out-and-back movements and subsequently judged the hand or cursor movement endpoints. In one condition, we omitted the online sensory causality evidence by showing the cursor only at the movement endpoint. The integration strength was lower than in conditions where the cursor was visible during the outward movement, but a substantial level of integration persisted. These findings support the hypothesis that the binding of actions and their visual consequences is based on the general mechanism of optimal integration, and they specifically show that such binding can occur even if it is previous experience only that identifies the action consequence.
Kayser C, Park H, Heuer H PLoS One. 2023; 18(8):e0290461.
PMID: 37607201 PMC: 10443876. DOI: 10.1371/journal.pone.0290461.
Conscious awareness of a visuo-proprioceptive mismatch: Effect on cross-sensory recalibration.
Hsiao A, Lee-Miller T, Block H Front Neurosci. 2022; 16:958513.
PMID: 36117619 PMC: 9470947. DOI: 10.3389/fnins.2022.958513.
On the Role of Interoception in Body and Object Perception: A Multisensory-Integration Account.
Kirsch W, Kunde W Perspect Psychol Sci. 2022; 18(2):321-339.
PMID: 35994810 PMC: 10018064. DOI: 10.1177/17456916221096138.
Perceptual changes after learning of an arbitrary mapping between vision and hand movements.
Kirsch W, Kunde W Sci Rep. 2022; 12(1):11427.
PMID: 35794174 PMC: 9259624. DOI: 10.1038/s41598-022-15579-8.
Visuo-proprioceptive integration and recalibration with multiple visual stimuli.
Debats N, Heuer H, Kayser C Sci Rep. 2021; 11(1):21640.
PMID: 34737371 PMC: 8569193. DOI: 10.1038/s41598-021-00992-2.