Independent Spatiotemporal Effects of Spatial Attention and Background Clutter on Human Object Location Representations

Overview

Journal Neuroimage

Specialty Radiology

Date 2023 Mar 26

PMID 36966853

Authors

Monika Graumann

Lara A Wallenwein

Radoslaw M Cichy

Affiliations

Soon will be listed here.

Abstract

Spatial attention helps us to efficiently localize objects in cluttered environments. However, the processing stage at which spatial attention modulates object location representations remains unclear. Here we investigated this question identifying processing stages in time and space in an EEG and fMRI experiment respectively. As both object location representations and attentional effects have been shown to depend on the background on which objects appear, we included object background as an experimental factor. During the experiments, human participants viewed images of objects appearing in different locations on blank or cluttered backgrounds while either performing a task on fixation or on the periphery to direct their covert spatial attention away or towards the objects. We used multivariate classification to assess object location information. Consistent across the EEG and fMRI experiment, we show that spatial attention modulated location representations during late processing stages (>150 ms, in middle and high ventral visual stream areas) independent of background condition. Our results clarify the processing stage at which attention modulates object location representations in the ventral visual stream and show that attentional modulation is a cognitive process separate from recurrent processes related to the processing of objects on cluttered backgrounds.

References

Herrero J, Gieselmann M, Sanayei M, Thiele A . Attention-induced variance and noise correlation reduction in macaque V1 is mediated by NMDA receptors. Neuron. 2013; 78(4):729-39. PMC: 3748348. DOI: 10.1016/j.neuron.2013.03.029. View

Vo M, Boettcher S, Draschkow D . Reading scenes: how scene grammar guides attention and aids perception in real-world environments. Curr Opin Psychol. 2019; 29:205-210. DOI: 10.1016/j.copsyc.2019.03.009. View

Kaiser D, Oosterhof N, Peelen M . The Neural Dynamics of Attentional Selection in Natural Scenes. J Neurosci. 2016; 36(41):10522-10528. PMC: 6601932. DOI: 10.1523/JNEUROSCI.1385-16.2016. View

Szczepanski S, Konen C, Kastner S . Mechanisms of spatial attention control in frontal and parietal cortex. J Neurosci. 2010; 30(1):148-60. PMC: 2809378. DOI: 10.1523/JNEUROSCI.3862-09.2010. View

Hillyard S, Vogel E, Luck S . Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. Philos Trans R Soc Lond B Biol Sci. 1998; 353(1373):1257-70. PMC: 1692341. DOI: 10.1098/rstb.1998.0281. View

Vaziri-Pashkam M, Xu Y . Goal-Directed Visual Processing Differentially Impacts Human Ventral and Dorsal Visual Representations. J Neurosci. 2017; 37(36):8767-8782. PMC: 5588467. DOI: 10.1523/JNEUROSCI.3392-16.2017. View

Lavie N . Perceptual load as a necessary condition for selective attention. J Exp Psychol Hum Percept Perform. 1995; 21(3):451-68. DOI: 10.1037//0096-1523.21.3.451. View

Martinez A, Di Russo F, Anllo-Vento L, Sereno M, Buxton R, Hillyard S . Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas. Vision Res. 2001; 41(10-11):1437-57. DOI: 10.1016/s0042-6989(00)00267-4. View

Seijdel N, Loke J, van de Klundert R, van der Meer M, Quispel E, van Gaal S . On the Necessity of Recurrent Processing during Object Recognition: It Depends on the Need for Scene Segmentation. J Neurosci. 2021; 41(29):6281-6289. PMC: 8287993. DOI: 10.1523/JNEUROSCI.2851-20.2021. View

10.

Chen Y, Martinez-Conde S, Macknik S, Bereshpolova Y, Swadlow H, Alonso J . Task difficulty modulates the activity of specific neuronal populations in primary visual cortex. Nat Neurosci. 2008; 11(8):974-82. PMC: 2553692. DOI: 10.1038/nn.2147. View

11.

Boudreau C, Williford T, Maunsell J . Effects of task difficulty and target likelihood in area V4 of macaque monkeys. J Neurophysiol. 2006; 96(5):2377-87. DOI: 10.1152/jn.01072.2005. View

12.

Seijdel N, Tsakmakidis N, de Haan E, Bohte S, Scholte H . Depth in convolutional neural networks solves scene segmentation. PLoS Comput Biol. 2020; 16(7):e1008022. PMC: 7406083. DOI: 10.1371/journal.pcbi.1008022. View

13.

Mangun G . Neural mechanisms of visual selective attention. Psychophysiology. 1995; 32(1):4-18. DOI: 10.1111/j.1469-8986.1995.tb03400.x. View

14.

Reddy L, Kanwisher N . Category selectivity in the ventral visual pathway confers robustness to clutter and diverted attention. Curr Biol. 2007; 17(23):2067-72. PMC: 2744456. DOI: 10.1016/j.cub.2007.10.043. View

15.

Graumann M, Ciuffi C, Dwivedi K, Roig G, Cichy R . The spatiotemporal neural dynamics of object location representations in the human brain. Nat Hum Behav. 2022; 6(6):796-811. PMC: 9225954. DOI: 10.1038/s41562-022-01302-0. View

16.

Wandell B, Winawer J . Computational neuroimaging and population receptive fields. Trends Cogn Sci. 2015; 19(6):349-57. PMC: 4484758. DOI: 10.1016/j.tics.2015.03.009. View

17.

Carlson T, Hogendoorn H, Kanai R, Mesik J, Turret J . High temporal resolution decoding of object position and category. J Vis. 2011; 11(10). DOI: 10.1167/11.10.9. View

18.

Peelen M, Kastner S . A neural basis for real-world visual search in human occipitotemporal cortex. Proc Natl Acad Sci U S A. 2011; 108(29):12125-30. PMC: 3141945. DOI: 10.1073/pnas.1101042108. View

19.

Rajaei K, Mohsenzadeh Y, Ebrahimpour R, Khaligh-Razavi S . Beyond core object recognition: Recurrent processes account for object recognition under occlusion. PLoS Comput Biol. 2019; 15(5):e1007001. PMC: 6538196. DOI: 10.1371/journal.pcbi.1007001. View

20.

Vanrullen R, Thorpe S . The time course of visual processing: from early perception to decision-making. J Cogn Neurosci. 2001; 13(4):454-61. DOI: 10.1162/08989290152001880. View