Information Theoretic Approaches to Understanding Circuit Function

Overview

Journal Curr Opin Neurobiol

Specialties Biology
Neurology

Date 2012 Jul 17

PMID 22795220

Citations 20

Authors

Adrienne Fairhall

Eric Shea-Brown

Andrea Barreiro

Affiliations

Soon will be listed here.

Abstract

The analysis of stimulus/response patterns using information theoretic approaches requires the full probability distribution of stimuli and response. Recent progress in using information-based tools to understand circuit function has advanced understanding of neural coding at the single cell and population level. In advances over traditional reverse correlation approaches, the determination of receptive fields using information as a metric has allowed novel insights into stimulus representation and transformation. The application of maximum entropy methods to population codes has opened a rich exploration of the internal structure of these codes, revealing stimulus-driven functional connectivity. We speculate about the prospects and limitations of information as a general tool for dissecting neural circuits and relating their structure and function.

Citing Articles

Sampling bias corrections for accurate neural measures of redundant, unique, and synergistic information.

Kocillari L, Lorenz G, Engel N, Celotto M, Curreli S, Blanco Malerba S bioRxiv. 2024; .

PMID: 38895197 PMC: 11185652. DOI: 10.1101/2024.06.04.597303.

Information-theoretical analysis of the neural code for decoupled face representation.

Ibanez-Berganza M, Lucibello C, Mariani L, Pezzulo G PLoS One. 2024; 19(1):e0295054.

PMID: 38277355 PMC: 10817192. DOI: 10.1371/journal.pone.0295054.

Computational methods to study information processing in neural circuits.

Koren V, Bondanelli G, Panzeri S Comput Struct Biotechnol J. 2023; 21:910-922.

PMID: 36698970 PMC: 9851868. DOI: 10.1016/j.csbj.2023.01.009.

Skilled motor control of an inverted pendulum implies low entropy of states but high entropy of actions.

Catenacci Volpi N, Greaves M, Trendafilov D, Salge C, Pezzulo G, Polani D PLoS Comput Biol. 2023; 19(1):e1010810.

PMID: 36608159 PMC: 9851554. DOI: 10.1371/journal.pcbi.1010810.

Unsupervised Bayesian Ising Approximation for decoding neural activity and other biological dictionaries.

Hernandez D, Sober S, Nemenman I Elife. 2022; 11.

PMID: 35315769 PMC: 8989415. DOI: 10.7554/eLife.68192.

References

Quian Quiroga R, Panzeri S . Extracting information from neuronal populations: information theory and decoding approaches. Nat Rev Neurosci. 2009; 10(3):173-85. DOI: 10.1038/nrn2578. View

Agarwala E, Chiel H, Thomas P . Pursuit of food versus pursuit of information in a Markovian perception-action loop model of foraging. J Theor Biol. 2012; 304:235-72. DOI: 10.1016/j.jtbi.2012.02.016. View

Oizumi M, Ishii T, Ishibashi K, Hosoya T, Okada M . Mismatched decoding in the brain. J Neurosci. 2010; 30(13):4815-26. PMC: 6632316. DOI: 10.1523/JNEUROSCI.4360-09.2010. View

Truccolo W, Eden U, Fellows M, Donoghue J, Brown E . A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J Neurophysiol. 2004; 93(2):1074-89. DOI: 10.1152/jn.00697.2004. View

Montani F, Ince R, Senatore R, Arabzadeh E, Diamond M, Panzeri S . The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex. Philos Trans A Math Phys Eng Sci. 2009; 367(1901):3297-310. DOI: 10.1098/rsta.2009.0082. View

Abbott L, Dayan P . The effect of correlated variability on the accuracy of a population code. Neural Comput. 1999; 11(1):91-101. DOI: 10.1162/089976699300016827. View

Series P, Latham P, Pouget A . Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations. Nat Neurosci. 2004; 7(10):1129-35. DOI: 10.1038/nn1321. View

Puchalla J, Schneidman E, Harris R, Berry M . Redundancy in the population code of the retina. Neuron. 2005; 46(3):493-504. DOI: 10.1016/j.neuron.2005.03.026. View

Najemnik J, Geisler W . Eye movement statistics in humans are consistent with an optimal search strategy. J Vis. 2008; 8(3):4.1-14. PMC: 2868380. DOI: 10.1167/8.3.4. View

10.

Vidne M, Ahmadian Y, Shlens J, Pillow J, Kulkarni J, Litke A . Modeling the impact of common noise inputs on the network activity of retinal ganglion cells. J Comput Neurosci. 2011; 33(1):97-121. PMC: 3560841. DOI: 10.1007/s10827-011-0376-2. View

11.

Srinivasan M, Laughlin S, Dubs A . Predictive coding: a fresh view of inhibition in the retina. Proc R Soc Lond B Biol Sci. 1982; 216(1205):427-59. DOI: 10.1098/rspb.1982.0085. View

12.

Sharpee T, Sugihara H, Kurgansky A, Rebrik S, Stryker M, Miller K . Adaptive filtering enhances information transmission in visual cortex. Nature. 2006; 439(7079):936-42. PMC: 2562720. DOI: 10.1038/nature04519. View

13.

Nemenman I, Lewen G, Bialek W, de Ruyter van Steveninck R . Neural coding of natural stimuli: information at sub-millisecond resolution. PLoS Comput Biol. 2008; 4(3):e1000025. PMC: 2265477. DOI: 10.1371/journal.pcbi.1000025. View

14.

Ganmor E, Segev R, Schneidman E . Sparse low-order interaction network underlies a highly correlated and learnable neural population code. Proc Natl Acad Sci U S A. 2011; 108(23):9679-84. PMC: 3111274. DOI: 10.1073/pnas.1019641108. View

15.

Latham P, Nirenberg S . Synergy, redundancy, and independence in population codes, revisited. J Neurosci. 2005; 25(21):5195-206. PMC: 6724819. DOI: 10.1523/JNEUROSCI.5319-04.2005. View

16.

Averbeck B, Lee D . Effects of noise correlations on information encoding and decoding. J Neurophysiol. 2006; 95(6):3633-44. DOI: 10.1152/jn.00919.2005. View

17.

Atick J . Could information theory provide an ecological theory of sensory processing?. Network. 2011; 22(1-4):4-44. DOI: 10.3109/0954898X.2011.638888. View

18.

Schwartz O, Pillow J, Rust N, Simoncelli E . Spike-triggered neural characterization. J Vis. 2006; 6(4):484-507. DOI: 10.1167/6.4.13. View

19.

Renninger L, Verghese P, Coughlan J . Where to look next? Eye movements reduce local uncertainty. J Vis. 2007; 7(3):6. DOI: 10.1167/7.3.6. View

20.

Sincich L, Horton J, Sharpee T . Preserving information in neural transmission. J Neurosci. 2009; 29(19):6207-16. PMC: 2761742. DOI: 10.1523/JNEUROSCI.3701-08.2009. View