Sparse Low-order Interaction Network Underlies a Highly Correlated and Learnable Neural Population Code

Overview

Journal Proc Natl Acad Sci U S A

Specialty Science

Date 2011 May 24

PMID 21602497

Citations 80

Authors

Elad Ganmor

Ronen Segev

Elad Schneidman

Affiliations

Soon will be listed here.

Abstract

Information is carried in the brain by the joint activity patterns of large groups of neurons. Understanding the structure and function of population neural codes is challenging because of the exponential number of possible activity patterns and dependencies among neurons. We report here that for groups of ~100 retinal neurons responding to natural stimuli, pairwise-based models, which were highly accurate for small networks, are no longer sufficient. We show that because of the sparse nature of the neural code, the higher-order interactions can be easily learned using a novel model and that a very sparse low-order interaction network underlies the code of large populations of neurons. Additionally, we show that the interaction network is organized in a hierarchical and modular manner, which hints at scalability. Our results suggest that learnability may be a key feature of the neural code.

Citing Articles

Entropy and Complexity Tools Across Scales in Neuroscience: A Review.

Cofre R, Destexhe A Entropy (Basel). 2025; 27(2).

PMID: 40003111 PMC: 11854896. DOI: 10.3390/e27020115.

Spontaneous Brain Activity Emerges from Pairwise Interactions in the Larval Zebrafish Brain.

Rosch R, Burrows D, Lynn C, Ashourvan A Phys Rev X. 2025; 14(3).

PMID: 39925410 PMC: 7617382. DOI: 10.1103/PhysRevX.14.031050.

Stimulus-invariant aspects of the retinal code drive discriminability of natural scenes.

Hoshal B, Holmes C, Bojanek K, Salisbury J, Berry 2nd M, Marre O Proc Natl Acad Sci U S A. 2024; 121(52):e2313676121.

PMID: 39700141 PMC: 11670243. DOI: 10.1073/pnas.2313676121.

Homeostatic synaptic normalization optimizes learning in network models of neural population codes.

Mayzel J, Schneidman E Elife. 2024; 13.

PMID: 39680435 PMC: 11649238. DOI: 10.7554/eLife.96566.

Adaptive modeling and inference of higher-order coordination in neuronal assemblies: A dynamic greedy estimation approach.

Mukherjee S, Babadi B PLoS Comput Biol. 2024; 20(5):e1011605.

PMID: 38805569 PMC: 11161120. DOI: 10.1371/journal.pcbi.1011605.

References

Hinton G, Osindero S, Teh Y . A fast learning algorithm for deep belief nets. Neural Comput. 2006; 18(7):1527-54. DOI: 10.1162/neco.2006.18.7.1527. View

Ohiorhenuan I, Mechler F, Purpura K, Schmid A, Hu Q, Victor J . Sparse coding and high-order correlations in fine-scale cortical networks. Nature. 2010; 466(7306):617-21. PMC: 2912961. DOI: 10.1038/nature09178. View

Tang A, Jackson D, Hobbs J, Chen W, Smith J, Patel H . A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J Neurosci. 2008; 28(2):505-18. PMC: 6670549. DOI: 10.1523/JNEUROSCI.3359-07.2008. View

Harris K, Csicsvari J, Hirase H, Dragoi G, Buzsaki G . Organization of cell assemblies in the hippocampus. Nature. 2003; 424(6948):552-6. DOI: 10.1038/nature01834. View

Stopfer M, Bhagavan S, Smith B, Laurent G . Impaired odour discrimination on desynchronization of odour-encoding neural assemblies. Nature. 1997; 390(6655):70-4. DOI: 10.1038/36335. View

Averbeck B, Lee D . Coding and transmission of information by neural ensembles. Trends Neurosci. 2004; 27(4):225-30. DOI: 10.1016/j.tins.2004.02.006. View

Chechik G, Anderson M, Bar-Yosef O, Young E, Tishby N, Nelken I . Reduction of information redundancy in the ascending auditory pathway. Neuron. 2006; 51(3):359-68. DOI: 10.1016/j.neuron.2006.06.030. View

Riehle A, Grun S, Diesmann M, Aertsen A . Spike synchronization and rate modulation differentially involved in motor cortical function. Science. 1998; 278(5345):1950-3. DOI: 10.1126/science.278.5345.1950. View

Olshausen B, Field D . Sparse coding of sensory inputs. Curr Opin Neurobiol. 2004; 14(4):481-7. DOI: 10.1016/j.conb.2004.07.007. View

10.

Schneidman E, Bialek W, Berry 2nd M . Synergy, redundancy, and independence in population codes. J Neurosci. 2003; 23(37):11539-53. PMC: 6740962. View

11.

Dan Y, Alonso J, Usrey W, Reid R . Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus. Nat Neurosci. 1999; 1(6):501-7. DOI: 10.1038/2217. View

12.

Lemasson G, Marder E, Abbott L . Activity-dependent regulation of conductances in model neurons. Science. 1993; 259(5103):1915-7. DOI: 10.1126/science.8456317. View

13.

Shlens J, Field G, Gauthier J, Greschner M, Sher A, Litke A . The structure of large-scale synchronized firing in primate retina. J Neurosci. 2009; 29(15):5022-31. PMC: 2678680. DOI: 10.1523/JNEUROSCI.5187-08.2009. View

14.

Brown E, Frank L, Tang D, Quirk M, Wilson M . A statistical paradigm for neural spike train decoding applied to position prediction from ensemble firing patterns of rat hippocampal place cells. J Neurosci. 1998; 18(18):7411-25. PMC: 6793233. View

15.

Bair W, Zohary E, Newsome W . Correlated firing in macaque visual area MT: time scales and relationship to behavior. J Neurosci. 2001; 21(5):1676-97. PMC: 6762960. View

16.

Marre O, El Boustani S, Fregnac Y, Destexhe A . Prediction of spatiotemporal patterns of neural activity from pairwise correlations. Phys Rev Lett. 2009; 102(13):138101. DOI: 10.1103/PhysRevLett.102.138101. View

17.

Georgopoulos A, Schwartz A, Kettner R . Neuronal population coding of movement direction. Science. 1986; 233(4771):1416-9. DOI: 10.1126/science.3749885. View

18.

Swendsen , Wang . Nonuniversal critical dynamics in Monte Carlo simulations. Phys Rev Lett. 1987; 58(2):86-88. DOI: 10.1103/PhysRevLett.58.86. View

19.

Schneidman E, Still S, Berry 2nd M, Bialek W . Network information and connected correlations. Phys Rev Lett. 2003; 91(23):238701. DOI: 10.1103/PhysRevLett.91.238701. View

20.

Simoncelli E, Olshausen B . Natural image statistics and neural representation. Annu Rev Neurosci. 2001; 24:1193-216. DOI: 10.1146/annurev.neuro.24.1.1193. View