» Articles » PMID: 38443349

Improved Modeling of Human Vision by Incorporating Robustness to Blur in Convolutional Neural Networks

Overview
Journal Nat Commun
Specialty Biology
Date 2024 Mar 5
PMID 38443349
Authors
Affiliations
Soon will be listed here.
Abstract

Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide multi-faceted neurocomputational evidence that blurry visual experiences may be critical for conferring robustness to biological visual systems.

Citing Articles

Configural processing as an optimized strategy for robust object recognition in neural networks.

Jang H, Sinha P, Boix X Commun Biol. 2025; 8(1):386.

PMID: 40055492 PMC: 11889204. DOI: 10.1038/s42003-025-07672-1.


Unraveling the complexity of rat object vision requires a full convolutional network and beyond.

Muratore P, Alemi A, Zoccolan D Patterns (N Y). 2025; 6(2):101149.

PMID: 40041851 PMC: 11873012. DOI: 10.1016/j.patter.2024.101149.


Convolutional neural network models applied to neuronal responses in macaque V1 reveal limited nonlinear processing.

Miao H, Tong F J Vis. 2024; 24(6):1.

PMID: 38829629 PMC: 11156204. DOI: 10.1167/jov.24.6.1.

References
1.
Gold J, Bennett P, Sekuler A . Signal but not noise changes with perceptual learning. Nature. 2000; 402(6758):176-8. DOI: 10.1038/46027. View

2.
Lu Z, Dosher B . External noise distinguishes attention mechanisms. Vision Res. 1998; 38(9):1183-98. DOI: 10.1016/s0042-6989(97)00273-3. View

3.
Kwon M, Legge G . Spatial-frequency cutoff requirements for pattern recognition in central and peripheral vision. Vision Res. 2011; 51(18):1995-2007. PMC: 3291662. DOI: 10.1016/j.visres.2011.06.020. View

4.
Pratte M, Ling S, Swisher J, Tong F . How attention extracts objects from noise. J Neurophysiol. 2013; 110(6):1346-56. PMC: 3763154. DOI: 10.1152/jn.00127.2013. View

5.
Jang H, McCormack D, Tong F . Noise-trained deep neural networks effectively predict human vision and its neural responses to challenging images. PLoS Biol. 2021; 19(12):e3001418. PMC: 8659651. DOI: 10.1371/journal.pbio.3001418. View