Attention During Natural Vision Warps Semantic Representation Across the Human Brain

Overview

Journal Nat Neurosci

Date 2013 Apr 23

PMID 23603707

Citations 131

Authors

Tolga Cukur

Shinji Nishimoto

Alexander G Huth

Jack L Gallant

Affiliations

Soon will be listed here.

Abstract

Little is known about how attention changes the cortical representation of sensory information in humans. On the basis of neurophysiological evidence, we hypothesized that attention causes tuning changes to expand the representation of attended stimuli at the cost of unattended stimuli. To investigate this issue, we used functional magnetic resonance imaging to measure how semantic representation changed during visual search for different object categories in natural movies. We found that many voxels across occipito-temporal and fronto-parietal cortex shifted their tuning toward the attended category. These tuning shifts expanded the representation of the attended category and of semantically related, but unattended, categories, and compressed the representation of categories that were semantically dissimilar to the target. Attentional warping of semantic representation occurred even when the attended category was not present in the movie; thus, the effect was not a target-detection artifact. These results suggest that attention dynamically alters visual representation to optimize processing of behaviorally relevant objects during natural vision.

Citing Articles

Youth Generalized Anxiety and Brain Activation States During Socioemotional Processing.

Camacho M, Schwarzlose R, Perino M, Labonte A, Koirala S, Barch D JAMA Psychiatry. 2024; 82(3):264-273.

PMID: 39693064 PMC: 11883562. DOI: 10.1001/jamapsychiatry.2024.4105.

Attention modulates human visual responses to objects by tuning sharpening.

Doostani N, Hossein-Zadeh G, Cichy R, Vaziri-Pashkam M Elife. 2024; 12.

PMID: 39680431 PMC: 11649243. DOI: 10.7554/eLife.89836.

Behaviorally-relevant features of observed actions dominate cortical representational geometry in natural vision.

Han J, Chauhan V, Philip R, Taylor M, Jung H, Halchenko Y Res Sq. 2024; .

PMID: 39678333 PMC: 11643331. DOI: 10.21203/rs.3.rs-5478816/v1.

Multimodal prediction of the need of clozapine in treatment resistant schizophrenia; a pilot study in first-episode psychosis.

Panula J, Gotsopoulos A, Alho J, Suvisaari J, Lindgren M, Kieseppa T Biomark Neuropsychiatry. 2024; 11:None.

PMID: 39669516 PMC: 11636528. DOI: 10.1016/j.bionps.2024.100102.

Extending insights from LeDoux: using movies to study subjective, clinically meaningful experiences in neuroscience.

Kirk P, Pine D, Kircanski K Cereb Cortex. 2024; 35(1):58-64.

PMID: 39422490 PMC: 11712263. DOI: 10.1093/cercor/bhae422.

References

Huth A, Nishimoto S, Vu A, Gallant J . A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron. 2012; 76(6):1210-24. PMC: 3556488. DOI: 10.1016/j.neuron.2012.10.014. View

David S, Gallant J . Predicting neuronal responses during natural vision. Network. 2006; 16(2-3):239-60. DOI: 10.1080/09548980500464030. View

Nishimoto S, Vu A, Naselaris T, Benjamini Y, Yu B, Gallant J . Reconstructing visual experiences from brain activity evoked by natural movies. Curr Biol. 2011; 21(19):1641-6. PMC: 3326357. DOI: 10.1016/j.cub.2011.08.031. View

Mitchell T, Shinkareva S, Carlson A, Chang K, Malave V, Mason R . Predicting human brain activity associated with the meanings of nouns. Science. 2008; 320(5880):1191-5. DOI: 10.1126/science.1152876. View

Carter C, Braver T, Barch D, Botvinick M, Noll D, Cohen J . Anterior cingulate cortex, error detection, and the online monitoring of performance. Science. 1998; 280(5364):747-9. DOI: 10.1126/science.280.5364.747. View

Peelen M, Fei-Fei L, Kastner S . Neural mechanisms of rapid natural scene categorization in human visual cortex. Nature. 2009; 460(7251):94-7. PMC: 2752739. DOI: 10.1038/nature08103. View

Luck S, Chelazzi L, Hillyard S, DeSimone R . Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. J Neurophysiol. 1997; 77(1):24-42. DOI: 10.1152/jn.1997.77.1.24. View

Hasson U, Nir Y, Levy I, Fuhrmann G, Malach R . Intersubject synchronization of cortical activity during natural vision. Science. 2004; 303(5664):1634-40. DOI: 10.1126/science.1089506. View

David S, Hayden B, Mazer J, Gallant J . Attention to stimulus features shifts spectral tuning of V4 neurons during natural vision. Neuron. 2008; 59(3):509-21. PMC: 2948549. DOI: 10.1016/j.neuron.2008.07.001. View

10.

Li F, VanRullen R, Koch C, Perona P . Rapid natural scene categorization in the near absence of attention. Proc Natl Acad Sci U S A. 2002; 99(14):9596-601. PMC: 123186. DOI: 10.1073/pnas.092277599. View

11.

Navalpakkam V, Itti L . Search goal tunes visual features optimally. Neuron. 2007; 53(4):605-17. DOI: 10.1016/j.neuron.2007.01.018. View

12.

Warden M, Miller E . Task-dependent changes in short-term memory in the prefrontal cortex. J Neurosci. 2010; 30(47):15801-10. PMC: 3082458. DOI: 10.1523/JNEUROSCI.1569-10.2010. View

13.

OCraven K, Downing P, Kanwisher N . fMRI evidence for objects as the units of attentional selection. Nature. 1999; 401(6753):584-7. DOI: 10.1038/44134. View

14.

Bartels A, Zeki S . Functional brain mapping during free viewing of natural scenes. Hum Brain Mapp. 2004; 21(2):75-85. PMC: 6872023. DOI: 10.1002/hbm.10153. View

15.

Mazer J, Gallant J . Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map. Neuron. 2003; 40(6):1241-50. DOI: 10.1016/s0896-6273(03)00764-5. View

16.

Reddy L, Kanwisher N . Category selectivity in the ventral visual pathway confers robustness to clutter and diverted attention. Curr Biol. 2007; 17(23):2067-72. PMC: 2744456. DOI: 10.1016/j.cub.2007.10.043. View

17.

Corbetta M, Shulman G . Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci. 2002; 3(3):201-15. DOI: 10.1038/nrn755. View

18.

Reynolds J, Pasternak T, DeSimone R . Attention increases sensitivity of V4 neurons. Neuron. 2000; 26(3):703-14. DOI: 10.1016/s0896-6273(00)81206-4. View

19.

Kay K, Naselaris T, Prenger R, Gallant J . Identifying natural images from human brain activity. Nature. 2008; 452(7185):352-5. PMC: 3556484. DOI: 10.1038/nature06713. View

20.

Asaad W, Rainer G, Miller E . Task-specific neural activity in the primate prefrontal cortex. J Neurophysiol. 2000; 84(1):451-9. DOI: 10.1152/jn.2000.84.1.451. View