Optimal Visual Search with Highly Heuristic Decision Rules

Overview

Journal ArXiv

Date 2024 Oct 14

PMID 39398220

Authors

Anqi Zhang

Wilson S Geisler

Affiliations

Soon will be listed here.

Abstract

Visual search is a fundamental natural task for humans and other animals. We investigated the decision processes humans use in covert (single-fixation) search with briefly presented displays having well-separated potential target locations. Performance was compared with the Bayesian-optimal decision process under the assumption that the information from the different potential target locations is statistically independent. Surprisingly, humans performed slightly better than optimal, despite humans' substantial loss of sensitivity in the fovea (foveal neglect), and the implausibility of the human brain replicating the optimal computations. We show that three factors can quantitatively explain these seemingly paradoxical results. Most importantly, simple and fixed heuristic decision rules reach near optimal search performance. Secondly, foveal neglect primarily affects only the central potential target location. Finally, spatially correlated neural noise can cause search performance to exceed that predicted for independent noise. These findings have broad implications for understanding visual search tasks and other identification tasks in humans and other animals.

References

Adams D, Sincich L, Horton J . Complete pattern of ocular dominance columns in human primary visual cortex. J Neurosci. 2007; 27(39):10391-403. PMC: 6673158. DOI: 10.1523/JNEUROSCI.2923-07.2007. View

Cowley B, Snyder A, Acar K, Williamson R, Yu B, Smith M . Slow Drift of Neural Activity as a Signature of Impulsivity in Macaque Visual and Prefrontal Cortex. Neuron. 2020; 108(3):551-567.e8. PMC: 7822647. DOI: 10.1016/j.neuron.2020.07.021. View

Cohen M, Kohn A . Measuring and interpreting neuronal correlations. Nat Neurosci. 2011; 14(7):811-9. PMC: 3586814. DOI: 10.1038/nn.2842. View

Palmer J, AMES C, Lindsey D . Measuring the effect of attention on simple visual search. J Exp Psychol Hum Percept Perform. 1993; 19(1):108-30. DOI: 10.1037//0096-1523.19.1.108. View

Carrasco M, Evert D, Chang I, KATZ S . The eccentricity effect: target eccentricity affects performance on conjunction searches. Percept Psychophys. 1995; 57(8):1241-61. DOI: 10.3758/bf03208380. View

Zhang A, Geisler W . Detection of targets in filtered noise: whitening in space and spatial frequency. J Opt Soc Am A Opt Image Sci Vis. 2022; 39(4):690-701. PMC: 9150084. DOI: 10.1364/JOSAA.447391. View

Greene H . The control of fixation duration in visual search. Perception. 2006; 35(3):303-15. DOI: 10.1068/p5329. View

Carandini M, Heeger D . Normalization as a canonical neural computation. Nat Rev Neurosci. 2011; 13(1):51-62. PMC: 3273486. DOI: 10.1038/nrn3136. View

Rosenbaum R, Smith M, Kohn A, Rubin J, Doiron B . The spatial structure of correlated neuronal variability. Nat Neurosci. 2016; 20(1):107-114. PMC: 5191923. DOI: 10.1038/nn.4433. View

10.

Peli E, Yang J, Goldstein R . Image invariance with changes in size: the role of peripheral contrast thresholds. J Opt Soc Am A. 1991; 8(11):1762-74. DOI: 10.1364/josaa.8.001762. View

11.

Eckstein M . Visual search: a retrospective. J Vis. 2012; 11(5). DOI: 10.1167/11.5.14. View

12.

Davis E, Palmer J . Visual search and attention: an overview. Spat Vis. 2004; 17(4-5):249-55. DOI: 10.1163/1568568041920168. View

13.

Albrecht D, Geisler W . Motion selectivity and the contrast-response function of simple cells in the visual cortex. Vis Neurosci. 1991; 7(6):531-46. DOI: 10.1017/s0952523800010336. View

14.

Verghese P . Active search for multiple targets is inefficient. Vision Res. 2012; 74:61-71. DOI: 10.1016/j.visres.2012.08.008. View

15.

Walshe R, Geisler W . Efficient allocation of attentional sensitivity gain in visual cortex reduces foveal sensitivity in visual search. Curr Biol. 2021; 32(1):26-36.e6. PMC: 8766254. DOI: 10.1016/j.cub.2021.10.011. View

16.

Geisler W . Contributions of ideal observer theory to vision research. Vision Res. 2010; 51(7):771-81. PMC: 3062724. DOI: 10.1016/j.visres.2010.09.027. View

17.

Rovamo J, Virsu V . An estimation and application of the human cortical magnification factor. Exp Brain Res. 1979; 37(3):495-510. DOI: 10.1007/BF00236819. View

18.

Najemnik J, Geisler W . Optimal eye movement strategies in visual search. Nature. 2005; 434(7031):387-91. DOI: 10.1038/nature03390. View

19.

Carrasco M, McElree B . Covert attention accelerates the rate of visual information processing. Proc Natl Acad Sci U S A. 2001; 98(9):5363-7. PMC: 33215. DOI: 10.1073/pnas.081074098. View

20.

Kohn A, Coen-Cagli R, Kanitscheider I, Pouget A . Correlations and Neuronal Population Information. Annu Rev Neurosci. 2016; 39:237-56. PMC: 5137197. DOI: 10.1146/annurev-neuro-070815-013851. View