Decoding Natural Sounds in Early "Visual" Cortex of Congenitally Blind Individuals

Overview

Journal Curr Biol

Publisher Cell Press

Specialty Biology

Date 2020 Jun 20

PMID 32559449

Citations 21

Authors

Petra Vetter

Lukasz Bola

Lior Reich

Matthew Bennett

Lars Muckli

Amir Amedi

Affiliations

Soon will be listed here.

Abstract

Complex natural sounds, such as bird singing, people talking, or traffic noise, induce decodable fMRI activation patterns in early visual cortex of sighted blindfolded participants [1]. That is, early visual cortex receives non-visual and potentially predictive information from audition. However, it is unclear whether the transfer of auditory information to early visual areas is an epiphenomenon of visual imagery or, alternatively, whether it is driven by mechanisms independent from visual experience. Here, we show that we can decode natural sounds from activity patterns in early "visual" areas of congenitally blind individuals who lack visual imagery. Thus, visual imagery is not a prerequisite of auditory feedback to early visual cortex. Furthermore, the spatial pattern of sound decoding accuracy in early visual cortex was remarkably similar in blind and sighted individuals, with an increasing decoding accuracy gradient from foveal to peripheral regions. This suggests that the typical organization by eccentricity of early visual cortex develops for auditory feedback, even in the lifelong absence of vision. The same feedback to early visual cortex might support visual perception in the sighted [1] and drive the recruitment of this area for non-visual functions in blind individuals [2, 3].

Citing Articles

Neural processing of naturalistic audiovisual events in space and time.

Hu Y, Mohsenzadeh Y Commun Biol. 2025; 8(1):110.

PMID: 39843939 PMC: 11754444. DOI: 10.1038/s42003-024-07434-5.

Retinotopic biases in contextual feedback signals to V1 for object and scene processing.

Bennett M, Petro L, Abbatecola C, Muckli L Curr Res Neurobiol. 2025; 8():100143.

PMID: 39810940 PMC: 11731975. DOI: 10.1016/j.crneur.2024.100143.

The transformation of sensory to perceptual braille letter representations in the visually deprived brain.

Haupt M, Graumann M, Teng S, Kaltenbach C, Cichy R Elife. 2024; 13.

PMID: 39630852 PMC: 11616995. DOI: 10.7554/eLife.98148.

EEG Cortical Sources of Theta, Beta and  Gamma Frequencies Orchestrate  Audio-Visual Interactions.

Dubey M, Chitturi V, Tayade P, Sharma R, Kaur S Ann Neurosci. 2024; :09727531241262193.

PMID: 39554719 PMC: 11561918. DOI: 10.1177/09727531241262193.

The visual cortex in the blind but not the auditory cortex in the deaf becomes multiple-demand regions.

Duymus H, Verma M, Gucluturk Y, Ozturk M, Varol A, Kurt S Brain. 2024; 147(10):3624-3637.

PMID: 38864500 PMC: 11449128. DOI: 10.1093/brain/awae187.

References

Smith F, Muckli L . Nonstimulated early visual areas carry information about surrounding context. Proc Natl Acad Sci U S A. 2010; 107(46):20099-103. PMC: 2993348. DOI: 10.1073/pnas.1000233107. View

van den Hurk J, Van Baelen M, Op de Beeck H . Development of visual category selectivity in ventral visual cortex does not require visual experience. Proc Natl Acad Sci U S A. 2017; 114(22):E4501-E4510. PMC: 5465914. DOI: 10.1073/pnas.1612862114. View

Pereira F, Botvinick M . Information mapping with pattern classifiers: a comparative study. Neuroimage. 2010; 56(2):476-96. PMC: 2975047. DOI: 10.1016/j.neuroimage.2010.05.026. View

Peelen M, Bracci S, Lu X, He C, Caramazza A, Bi Y . Tool selectivity in left occipitotemporal cortex develops without vision. J Cogn Neurosci. 2013; 25(8):1225-34. DOI: 10.1162/jocn_a_00411. View

Norman L, Thaler L . Retinotopic-like maps of spatial sound in primary 'visual' cortex of blind human echolocators. Proc Biol Sci. 2019; 286(1912):20191910. PMC: 6790759. DOI: 10.1098/rspb.2019.1910. View

Amedi A, Floel A, Knecht S, Zohary E, Cohen L . Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects. Nat Neurosci. 2004; 7(11):1266-70. DOI: 10.1038/nn1328. View

Eckert M, Kamdar N, Chang C, Beckmann C, Greicius M, Menon V . A cross-modal system linking primary auditory and visual cortices: evidence from intrinsic fMRI connectivity analysis. Hum Brain Mapp. 2008; 29(7):848-57. PMC: 2605422. DOI: 10.1002/hbm.20560. View

Eklund A, Nichols T, Knutsson H . Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates. Proc Natl Acad Sci U S A. 2016; 113(28):7900-5. PMC: 4948312. DOI: 10.1073/pnas.1602413113. View

Gandhi S, Heeger D, Boynton G . Spatial attention affects brain activity in human primary visual cortex. Proc Natl Acad Sci U S A. 1999; 96(6):3314-9. PMC: 15939. DOI: 10.1073/pnas.96.6.3314. View

10.

Benson N, Butt O, Datta R, Radoeva P, Brainard D, Aguirre G . The retinotopic organization of striate cortex is well predicted by surface topology. Curr Biol. 2012; 22(21):2081-5. PMC: 3494819. DOI: 10.1016/j.cub.2012.09.014. View

11.

Keller G, Mrsic-Flogel T . Predictive Processing: A Canonical Cortical Computation. Neuron. 2018; 100(2):424-435. PMC: 6400266. DOI: 10.1016/j.neuron.2018.10.003. View

12.

Campus C, Sandini G, Morrone M, Gori M . Spatial localization of sound elicits early responses from occipital visual cortex in humans. Sci Rep. 2017; 7(1):10415. PMC: 5585168. DOI: 10.1038/s41598-017-09142-z. View

13.

Dormal G, Rezk M, Yakobov E, Lepore F, Collignon O . Auditory motion in the sighted and blind: Early visual deprivation triggers a large-scale imbalance between auditory and "visual" brain regions. Neuroimage. 2016; 134:630-644. DOI: 10.1016/j.neuroimage.2016.04.027. View

14.

Wang X, Peelen M, Han Z, He C, Caramazza A, Bi Y . How Visual Is the Visual Cortex? Comparing Connectional and Functional Fingerprints between Congenitally Blind and Sighted Individuals. J Neurosci. 2015; 35(36):12545-59. PMC: 6605405. DOI: 10.1523/JNEUROSCI.3914-14.2015. View

15.

Striem-Amit E, Ovadia-Caro S, Caramazza A, Margulies D, Villringer A, Amedi A . Functional connectivity of visual cortex in the blind follows retinotopic organization principles. Brain. 2015; 138(Pt 6):1679-95. PMC: 4614142. DOI: 10.1093/brain/awv083. View

16.

Petro L, Paton A, Muckli L . Contextual modulation of primary visual cortex by auditory signals. Philos Trans R Soc Lond B Biol Sci. 2017; 372(1714). PMC: 5206272. DOI: 10.1098/rstb.2016.0104. View

17.

Stelzer J, Chen Y, Turner R . Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): random permutations and cluster size control. Neuroimage. 2012; 65:69-82. DOI: 10.1016/j.neuroimage.2012.09.063. View

18.

Mahon B, Anzellotti S, Schwarzbach J, Zampini M, Caramazza A . Category-specific organization in the human brain does not require visual experience. Neuron. 2009; 63(3):397-405. PMC: 2743253. DOI: 10.1016/j.neuron.2009.07.012. View

19.

Falchier A, Clavagnier S, Barone P, Kennedy H . Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci. 2002; 22(13):5749-59. PMC: 6758216. DOI: 20026562. View

20.

Schira M, Tyler C, Breakspear M, Spehar B . The foveal confluence in human visual cortex. J Neurosci. 2009; 29(28):9050-8. PMC: 6665445. DOI: 10.1523/JNEUROSCI.1760-09.2009. View