Attention in Psychology, Neuroscience, and Machine Learning

Overview

Journal Front Comput Neurosci

Specialty Biology

Date 2020 May 7

PMID 32372937

Citations 43

Authors

Grace W Lindsay

Affiliations

Soon will be listed here.

Abstract

Attention is the important ability to flexibly control limited computational resources. It has been studied in conjunction with many other topics in neuroscience and psychology including awareness, vigilance, saliency, executive control, and learning. It has also recently been applied in several domains in machine learning. The relationship between the study of biological attention and its use as a tool to enhance artificial neural networks is not always clear. This review starts by providing an overview of how attention is conceptualized in the neuroscience and psychology literature. It then covers several use cases of attention in machine learning, indicating their biological counterparts where they exist. Finally, the ways in which artificial attention can be further inspired by biology for the production of complex and integrative systems is explored.

Citing Articles

The influence of social interactions in mitigating psychological distress during the COVID-19 pandemic: a study in Sri Lanka.

Thilakasiri I, Fonseka T, Mapa I, Godaliyadda R, Herath V, Thowfeek R Front Psychol. 2025; 15():1491805.

PMID: 39834767 PMC: 11743622. DOI: 10.3389/fpsyg.2024.1491805.

Selective Auditory Attention Detection Using Combined Transformer and Convolutional Graph Neural Networks.

Geravanchizadeh M, Shaygan Asl A, Danishvar S Bioengineering (Basel). 2025; 11(12.

PMID: 39768034 PMC: 11673410. DOI: 10.3390/bioengineering11121216.

Benchmarking the speed-accuracy tradeoff in object recognition by humans and neural networks.

Subramanian A, Price S, Kumbhar O, Sizikova E, Majaj N, Pelli D J Vis. 2025; 25(1):4.

PMID: 39752176 PMC: 11706240. DOI: 10.1167/jov.25.1.4.

Improvement of persistent impairments in executive functions and attention following electroconvulsive therapy in a case control longitudinal follow up study.

Hammar A, Ronold E, Spurkeland M, Ueland R, Kessler U, Oedegaard K BMC Psychiatry. 2024; 24(1):832.

PMID: 39567961 PMC: 11577909. DOI: 10.1186/s12888-024-06270-5.

The application of eXplainable artificial intelligence in studying cognition: A scoping review.

Mahmood S, Teo C, Sim J, Zhang W, Muyun J, Bhuvana R Ibrain. 2024; 10(3):245-265.

PMID: 39346792 PMC: 11427810. DOI: 10.1002/ibra.12174.

References

Seitz A, Watanabe T . Psychophysics: Is subliminal learning really passive?. Nature. 2003; 422(6927):36. DOI: 10.1038/422036a. View

Buschman T, Miller E . Serial, covert shifts of attention during visual search are reflected by the frontal eye fields and correlated with population oscillations. Neuron. 2009; 63(3):386-96. PMC: 2758537. DOI: 10.1016/j.neuron.2009.06.020. View

Fritz J, Elhilali M, David S, Shamma S . Auditory attention--focusing the searchlight on sound. Curr Opin Neurobiol. 2007; 17(4):437-55. DOI: 10.1016/j.conb.2007.07.011. View

Birman D, Gardner J . A flexible readout mechanism of human sensory representations. Nat Commun. 2019; 10(1):3500. PMC: 6677769. DOI: 10.1038/s41467-019-11448-7. View

Ahissar M, Hochstein S . The spread of attention and learning in feature search: effects of target distribution and task difficulty. Vision Res. 2000; 40(10-12):1349-64. DOI: 10.1016/s0042-6989(00)00002-x. View

Driver J . A selective review of selective attention research from the past century. Br J Psychol. 2001; 92(Pt 1):53-78. View

OCraven K, Downing P, Kanwisher N . fMRI evidence for objects as the units of attentional selection. Nature. 1999; 401(6753):584-7. DOI: 10.1038/44134. View

Keller A . Attention and olfactory consciousness. Front Psychol. 2011; 2:380. PMC: 3241345. DOI: 10.3389/fpsyg.2011.00380. View

Moore T, Armstrong K, Fallah M . Visuomotor origins of covert spatial attention. Neuron. 2003; 40(4):671-83. DOI: 10.1016/s0896-6273(03)00716-5. View

10.

Anton-Erxleben K, Carrasco M . Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence. Nat Rev Neurosci. 2013; 14(3):188-200. PMC: 3977878. DOI: 10.1038/nrn3443. View

11.

Hommel B, Chapman C, Cisek P, Neyedli H, Song J, Welsh T . No one knows what attention is. Atten Percept Psychophys. 2019; 81(7):2288-2303. PMC: 6848248. DOI: 10.3758/s13414-019-01846-w. View

12.

Itti L, Koch C . Computational modelling of visual attention. Nat Rev Neurosci. 2001; 2(3):194-203. DOI: 10.1038/35058500. View

13.

Treue S, Martinez Trujillo J . Feature-based attention influences motion processing gain in macaque visual cortex. Nature. 1999; 399(6736):575-9. DOI: 10.1038/21176. View

14.

Baars B . Global workspace theory of consciousness: toward a cognitive neuroscience of human experience. Prog Brain Res. 2005; 150:45-53. DOI: 10.1016/S0079-6123(05)50004-9. View

15.

Zelinsky G, Chen Y, Ahn S, Adeli H, Yang Z, Huang L . Predicting Goal-directed Attention Control Using Inverse-Reinforcement Learning. Neuron Behav Data Anal Theory. 2021; 2021. PMC: 8218820. DOI: 10.51628/001c.22322. View

16.

Tatler B, Baddeley R, Gilchrist I . Visual correlates of fixation selection: effects of scale and time. Vision Res. 2004; 45(5):643-59. DOI: 10.1016/j.visres.2004.09.017. View

17.

Hutmacher F . Why Is There So Much More Research on Vision Than on Any Other Sensory Modality?. Front Psychol. 2019; 10:2246. PMC: 6787282. DOI: 10.3389/fpsyg.2019.02246. View

18.

Paneri S, Gregoriou G . Top-Down Control of Visual Attention by the Prefrontal Cortex. Functional Specialization and Long-Range Interactions. Front Neurosci. 2017; 11:545. PMC: 5626849. DOI: 10.3389/fnins.2017.00545. View

19.

Spence C . Explaining the Colavita visual dominance effect. Prog Brain Res. 2009; 176:245-58. DOI: 10.1016/S0079-6123(09)17615-X. View

20.

Lozito J, Mulligan N . Exploring the role of attention during memory retrieval: effects of semantic encoding and divided attention. Mem Cognit. 2006; 34(5):986-98. DOI: 10.3758/bf03193246. View