Implicit Expectation Modulates Multisensory Perception

Overview

Journal Atten Percept Psychophys

Publisher Springer

Specialties Psychiatry
Psychology

Date 2022 Mar 2

PMID 35233744

Authors

Mick Zeljko

Philip M Grove

Ada Kritikos

Affiliations

Soon will be listed here.

Abstract

Stimulus statistics can induce expectations that in turn can influence multisensory perception. In three experiments, we manipulate perceptual history by biasing stimulus statistics and examined the effect of implicit expectations on the perceptual resolution of a bistable visual stimulus that is modulated by sound. First, we found a general effect of expectation such that responses were biased in line with the biased statistics and interpret this as a bias towards an implicitly expected outcome. Second, expectation did not influence the perception of all types of stimuli. In both Experiment 1 and Experiment 2, integrated audio-visual stimuli were affected by expectation but visual-only and unintegrated audio-visual stimuli were not. In Experiment 3 we examined the sensory versus interpretational effects of expectation and found that contrary to our predictions, an expectation of audio-visually integrated stimuli was associated with impaired multisensory integration compared to visual-only or unintegrated audio-visual stimuli. Our findings suggest that perceptual experience implicitly creates expectations that influence multisensory perception, which appear to be about perceptual outcomes rather than sensory stimuli. Finally, in the case of resolving perceptual ambiguity, the expectation effect is an effect on cognitive rather than sensory processes.

References

Biederman I, Mezzanotte R, RABINOWITZ J . Scene perception: detecting and judging objects undergoing relational violations. Cogn Psychol. 1982; 14(2):143-77. DOI: 10.1016/0010-0285(82)90007-x. View

Brainard D . The Psychophysics Toolbox. Spat Vis. 1997; 10(4):433-6. View

Brascamp J, Knapen T, Kanai R, Noest A, van Ee R, van den Berg A . Multi-timescale perceptual history resolves visual ambiguity. PLoS One. 2008; 3(1):e1497. PMC: 2204053. DOI: 10.1371/journal.pone.0001497. View

Brascamp J, Kanai R, Walsh V, van Ee R . Human middle temporal cortex, perceptual bias, and perceptual memory for ambiguous three-dimensional motion. J Neurosci. 2010; 30(2):760-6. PMC: 6633007. DOI: 10.1523/JNEUROSCI.4171-09.2010. View

Costantini M, Migliorati D, Donno B, Sirota M, Ferri F . Expected but omitted stimuli affect crossmodal interaction. Cognition. 2017; 171:52-64. DOI: 10.1016/j.cognition.2017.10.016. View

Einhauser W, Methfessel P, Bendixen A . Newly acquired audio-visual associations bias perception in binocular rivalry. Vision Res. 2017; 133:121-129. DOI: 10.1016/j.visres.2017.02.001. View

Ernst M, Bulthoff H . Merging the senses into a robust percept. Trends Cogn Sci. 2004; 8(4):162-9. DOI: 10.1016/j.tics.2004.02.002. View

Faul F, Erdfelder E, Lang A, Buchner A . G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007; 39(2):175-91. DOI: 10.3758/bf03193146. View

Fiorini L, Berchicci M, Mussini E, Bianco V, Lucia S, DI Russo F . Neural Basis of Anticipatory Multisensory Integration. Brain Sci. 2021; 11(7). PMC: 8301880. DOI: 10.3390/brainsci11070843. View

10.

Gau R, Noppeney U . How prior expectations shape multisensory perception. Neuroimage. 2015; 124(Pt A):876-886. DOI: 10.1016/j.neuroimage.2015.09.045. View

11.

Gekas N, Seitz A, Series P . Expectations developed over multiple timescales facilitate visual search performance. J Vis. 2015; 15(9):10. PMC: 4511121. DOI: 10.1167/15.9.10. View

12.

Gilbert C, Sigman M . Brain states: top-down influences in sensory processing. Neuron. 2007; 54(5):677-96. DOI: 10.1016/j.neuron.2007.05.019. View

13.

Grove P, Robertson C, Harris L . Disambiguating the Stream/Bounce Illusion With Inference. Multisens Res. 2018; 29(4-5):453-64. DOI: 10.1163/22134808-00002524. View

14.

Helbig H, Ernst M . Knowledge about a common source can promote visual- haptic integration. Perception. 2008; 36(10):1523-33. DOI: 10.1068/p5851. View

15.

Intaite M, Noreika V, Soliunas A, Falter C . Interaction of bottom-up and top-down processes in the perception of ambiguous figures. Vision Res. 2013; 89:24-31. DOI: 10.1016/j.visres.2013.06.011. View

16.

Kersten D, Mamassian P, Yuille A . Object perception as Bayesian inference. Annu Rev Psychol. 2004; 55:271-304. DOI: 10.1146/annurev.psych.55.090902.142005. View

17.

Kornmeier J, Hein C, Bach M . Multistable perception: when bottom-up and top-down coincide. Brain Cogn. 2008; 69(1):138-47. DOI: 10.1016/j.bandc.2008.06.005. View

18.

Maloney L, Dal Martello M, Sahm C, Spillmann L . Past trials influence perception of ambiguous motion quartets through pattern completion. Proc Natl Acad Sci U S A. 2005; 102(8):3164-9. PMC: 549457. DOI: 10.1073/pnas.0407157102. View

19.

Maniglia M, Grassi M, Casco C, Campana G . The origin of the audiovisual bounce inducing effect: a TMS study. Neuropsychologia. 2012; 50(7):1478-82. DOI: 10.1016/j.neuropsychologia.2012.02.033. View

20.

Ouhnana M, Kingdom F . Perceptual-binding in a rotating Necker cube: The effect of context motion and position. Vision Res. 2016; 126:59-68. DOI: 10.1016/j.visres.2016.02.005. View