Cumulative Inhibition in Neural Networks

Overview

Journal Cogn Process

Specialty Psychology

Date 2018 Nov 5

PMID 30392141

Authors

Trond A Tjostheim

Christian Balkenius

Affiliations

Soon will be listed here.

Abstract

We show how a multi-resolution network can model the development of acuity and coarse-to-fine processing in the mammalian visual cortex. The network adapts to input statistics in an unsupervised manner, and learns a coarse-to-fine representation by using cumulative inhibition of nodes within a network layer. We show that a system of such layers can represent input by hierarchically composing larger parts from smaller components. It can also model aspects of top-down processes, such as image regeneration.

References

Hensch T . Critical period plasticity in local cortical circuits. Nat Rev Neurosci. 2005; 6(11):877-88. DOI: 10.1038/nrn1787. View

Hubel D, Wiesel T . Receptive fields and functional architecture of monkey striate cortex. J Physiol. 1968; 195(1):215-43. PMC: 1557912. DOI: 10.1113/jphysiol.1968.sp008455. View

Ahissar M, Hochstein S . The reverse hierarchy theory of visual perceptual learning. Trends Cogn Sci. 2004; 8(10):457-64. DOI: 10.1016/j.tics.2004.08.011. View

Xue M, Atallah B, Scanziani M . Equalizing excitation-inhibition ratios across visual cortical neurons. Nature. 2014; 511(7511):596-600. PMC: 4117808. DOI: 10.1038/nature13321. View

Binzegger T, Douglas R, Martin K . Topology and dynamics of the canonical circuit of cat V1. Neural Netw. 2009; 22(8):1071-8. DOI: 10.1016/j.neunet.2009.07.011. View

Schmidhuber J . Deep learning in neural networks: an overview. Neural Netw. 2014; 61:85-117. DOI: 10.1016/j.neunet.2014.09.003. View

Keresztes A, Bender A, Bodammer N, Lindenberger U, Lee Shing Y, Werkle-Bergner M . Hippocampal maturity promotes memory distinctiveness in childhood and adolescence. Proc Natl Acad Sci U S A. 2017; 114(34):9212-9217. PMC: 5576837. DOI: 10.1073/pnas.1710654114. View

Huang Z, Kirkwood A, Pizzorusso T, Porciatti V, Morales B, Bear M . BDNF regulates the maturation of inhibition and the critical period of plasticity in mouse visual cortex. Cell. 1999; 98(6):739-55. DOI: 10.1016/s0092-8674(00)81509-3. View

Freeman D, MARG E . Visual acuity development coincides with the sensitive period in kittens. Nature. 1975; 254(5501):614-5. DOI: 10.1038/254614a0. View

10.

Bouvet L, Rousset S, Valdois S, Donnadieu S . Global precedence effect in audition and vision: evidence for similar cognitive styles across modalities. Acta Psychol (Amst). 2011; 138(2):329-35. DOI: 10.1016/j.actpsy.2011.08.004. View

11.

Fagiolini M, Pizzorusso T, Berardi N, Domenici L, Maffei L . Functional postnatal development of the rat primary visual cortex and the role of visual experience: dark rearing and monocular deprivation. Vision Res. 1994; 34(6):709-20. DOI: 10.1016/0042-6989(94)90210-0. View

12.

Campana F, Rebollo I, Urai A, Wyart V, Tallon-Baudry C . Conscious Vision Proceeds from Global to Local Content in Goal-Directed Tasks and Spontaneous Vision. J Neurosci. 2016; 36(19):5200-13. PMC: 6601801. DOI: 10.1523/JNEUROSCI.3619-15.2016. View

13.

Pomerantz J . Global and local precedence: selective attention in form and motion perception. J Exp Psychol Gen. 1983; 112(4):516-40. DOI: 10.1037//0096-3445.112.4.516. View

14.

Foldiak P . Forming sparse representations by local anti-Hebbian learning. Biol Cybern. 1990; 64(2):165-70. DOI: 10.1007/BF02331346. View

15.

Hassabis D, Maguire E . Deconstructing episodic memory with construction. Trends Cogn Sci. 2007; 11(7):299-306. DOI: 10.1016/j.tics.2007.05.001. View

16.

Shibasaki M, Kawai N . Rapid detection of snakes by Japanese monkeys (Macaca fuscata): an evolutionarily predisposed visual system. J Comp Psychol. 2009; 123(2):131-5. DOI: 10.1037/a0015095. View

17.

Wagatsuma N, Potjans T, Diesmann M, Fukai T . Layer-Dependent Attentional Processing by Top-down Signals in a Visual Cortical Microcircuit Model. Front Comput Neurosci. 2011; 5:31. PMC: 3134838. DOI: 10.3389/fncom.2011.00031. View

18.

Hassabis D, Kumaran D, Vann S, Maguire E . Patients with hippocampal amnesia cannot imagine new experiences. Proc Natl Acad Sci U S A. 2007; 104(5):1726-31. PMC: 1773058. DOI: 10.1073/pnas.0610561104. View

19.

BARLOW H . Single units and sensation: a neuron doctrine for perceptual psychology?. Perception. 1972; 1(4):371-94. DOI: 10.1068/p010371. View

20.

Olshausen B, Field D . Sparse coding of sensory inputs. Curr Opin Neurobiol. 2004; 14(4):481-7. DOI: 10.1016/j.conb.2004.07.007. View