Inferring Visual Space from Ultra-fine Extra-retinal Knowledge of Gaze Position

Overview

Journal Nat Commun

Specialty Biology

Date 2023 Jan 17

PMID 36650146

Authors

Zhetuo Zhao

Ehud Ahissar

Jonathan D Victor

Michele Rucci

Affiliations

Soon will be listed here.

Abstract

It has long been debated how humans resolve fine details and perceive a stable visual world despite the incessant fixational motion of their eyes. Current theories assume these processes to rely solely on the visual input to the retina, without contributions from motor and/or proprioceptive sources. Here we show that contrary to this widespread assumption, the visual system has access to high-resolution extra-retinal knowledge of fixational eye motion and uses it to deduce spatial relations. Building on recent advances in gaze-contingent display control, we created a spatial discrimination task in which the stimulus configuration was entirely determined by oculomotor activity. Our results show that humans correctly infer geometrical relations in the absence of spatial information on the retina and accurately combine high-resolution extraretinal monitoring of gaze displacement with retinal signals. These findings reveal a sensory-motor strategy for encoding space, in which fine oculomotor knowledge is used to interpret the fixational input to the retina.

Citing Articles

The visual system does not operate like a camera.

Rucci M, Ahissar E, Burr D, Kagan I, Poletti M, Victor J J Vis. 2025; 25(3):2.

PMID: 40035715 PMC: 11892792. DOI: 10.1167/jov.25.3.2.

Building egocentric models of local space from retinal input.

Martins D, Manda J, Goard M, Parker P Curr Biol. 2024; 34(23):R1185-R1202.

PMID: 39626632 PMC: 11620475. DOI: 10.1016/j.cub.2024.10.057.

A paradoxical misperception of relative motion.

DAngelo J, Tiruveedhula P, Weber R, Arathorn D, Roorda A Proc Natl Acad Sci U S A. 2024; 121(48):e2410755121.

PMID: 39570307 PMC: 11621632. DOI: 10.1073/pnas.2410755121.

Sub-cone visual resolution by active, adaptive sampling in the human foveola.

Witten J, Lukyanova V, Harmening W Elife. 2024; 13.

PMID: 39468921 PMC: 11521370. DOI: 10.7554/eLife.98648.

Fixational eye movements enhance the precision of visual information transmitted by the primate retina.

Wu E, Brackbill N, Rhoades C, Kling A, Gogliettino A, Shah N Nat Commun. 2024; 15(1):7964.

PMID: 39261491 PMC: 11390888. DOI: 10.1038/s41467-024-52304-7.

References

Benedetto A, Morrone M . Saccadic Suppression Is Embedded Within Extended Oscillatory Modulation of Sensitivity. J Neurosci. 2017; 37(13):3661-3670. PMC: 6596918. DOI: 10.1523/JNEUROSCI.2390-16.2016. View

Burak Y, Rokni U, Meister M, Sompolinsky H . Bayesian model of dynamic image stabilization in the visual system. Proc Natl Acad Sci U S A. 2010; 107(45):19525-30. PMC: 2984143. DOI: 10.1073/pnas.1006076107. View

Spering M, Montagnini A . Do we track what we see? Common versus independent processing for motion perception and smooth pursuit eye movements: a review. Vision Res. 2010; 51(8):836-52. DOI: 10.1016/j.visres.2010.10.017. View

Motter B, POGGIO G . Dynamic stabilization of receptive fields of cortical neurons (VI) during fixation of gaze in the macaque. Exp Brain Res. 1990; 83(1):37-43. DOI: 10.1007/BF00232191. View

Spering M, Gegenfurtner K . Contrast and assimilation in motion perception and smooth pursuit eye movements. J Neurophysiol. 2007; 98(3):1355-63. DOI: 10.1152/jn.00476.2007. View

Freeman T, Champion R, Warren P . A Bayesian model of perceived head-centered velocity during smooth pursuit eye movement. Curr Biol. 2010; 20(8):757-62. PMC: 2861164. DOI: 10.1016/j.cub.2010.02.059. View

Anderson A, Ratnam K, Roorda A, Olshausen B . High-acuity vision from retinal image motion. J Vis. 2020; 20(7):34. PMC: 7424138. DOI: 10.1167/jov.20.7.34. View

Reppas J, Usrey W, Reid R . Saccadic eye movements modulate visual responses in the lateral geniculate nucleus. Neuron. 2002; 35(5):961-74. DOI: 10.1016/s0896-6273(02)00823-1. View

CORNSWEET T . Determination of the stimuli for involuntary drifts and saccadic eye movements. J Opt Soc Am. 1956; 46(11):987-93. DOI: 10.1364/josa.46.000987. View

10.

Melcher D, Morrone M . Spatiotopic temporal integration of visual motion across saccadic eye movements. Nat Neurosci. 2003; 6(8):877-81. DOI: 10.1038/nn1098. View

11.

Poletti M, Burr D, Rucci M . Optimal multimodal integration in spatial localization. J Neurosci. 2013; 33(35):14259-68. PMC: 3756764. DOI: 10.1523/JNEUROSCI.0523-13.2013. View

12.

Wurtz R . Corollary Discharge Contributions to Perceptual Continuity Across Saccades. Annu Rev Vis Sci. 2018; 4:215-237. DOI: 10.1146/annurev-vision-102016-061207. View

13.

Murakami I, Cavanagh P . A jitter after-effect reveals motion-based stabilization of vision. Nature. 1998; 395(6704):798-801. DOI: 10.1038/27435. View

14.

Nadler J, Nawrot M, Angelaki D, DeAngelis G . MT neurons combine visual motion with a smooth eye movement signal to code depth-sign from motion parallax. Neuron. 2009; 63(4):523-32. PMC: 2736789. DOI: 10.1016/j.neuron.2009.07.029. View

15.

Benardete E, Kaplan E . The receptive field of the primate P retinal ganglion cell, I: Linear dynamics. Vis Neurosci. 1997; 14(1):169-85. DOI: 10.1017/s0952523800008853. View

16.

DAvossa G, Tosetti M, Crespi S, Biagi L, Burr D, Morrone M . Spatiotopic selectivity of BOLD responses to visual motion in human area MT. Nat Neurosci. 2007; 10(2):249-55. DOI: 10.1038/nn1824. View

17.

Nachmias J . Determiners of the drift of the eye during monocular fixation. J Opt Soc Am. 1961; 51:761-6. DOI: 10.1364/josa.51.000761. View

18.

Gur M, Snodderly D . Visual receptive fields of neurons in primary visual cortex (V1) move in space with the eye movements of fixation. Vision Res. 1997; 37(3):257-65. DOI: 10.1016/s0042-6989(96)00182-4. View

19.

Lappe , Bremmer , van den Berg AV . Perception of self-motion from visual flow. Trends Cogn Sci. 1999; 3(9):329-336. DOI: 10.1016/s1364-6613(99)01364-9. View

20.

Galletti C, Battaglini P, Fattori P . Parietal neurons encoding spatial locations in craniotopic coordinates. Exp Brain Res. 1993; 96(2):221-9. DOI: 10.1007/BF00227102. View