Palimpsest Memories Stored in Memristive Synapses

Overview

Journal Sci Adv

Specialties Biology
Science

Date 2022 Jun 22

PMID 35731877

Authors

Christos Giotis

Alexander Serb

Vasileios Manouras

Spyros Stathopoulos

Themis Prodromakis

Affiliations

Soon will be listed here.

Abstract

Biological synapses store multiple memories on top of each other in a palimpsest fashion and at different time scales. Palimpsest consolidation is facilitated by the interaction of hidden biochemical processes governing synaptic efficacy during varying lifetimes. This arrangement allows idle memories to be temporarily overwritten without being forgotten, while previously unseen memories are used in the short term. While embedded artificial intelligence can greatly benefit from this functionality, a practical demonstration in hardware is missing. Here, we show how the intrinsic properties of metal-oxide volatile memristors emulate the processes supporting biological palimpsest consolidation. Our memristive synapses exhibit an expanded doubled capacity and protect a consolidated memory while up to hundreds of uncorrelated short-term memories temporarily overwrite it, without requiring specialized instructions. We further demonstrate this technology in the context of visual working memory. This showcases how emerging memory technologies can efficiently expand the capabilities of artificial intelligence hardware toward more generalized learning memories.

Citing Articles

On-device synaptic memory consolidation using Fowler-Nordheim quantum-tunneling.

Rahman M, Bose S, Chakrabartty S Front Neurosci. 2023; 16:1050585.

PMID: 36711131 PMC: 9880265. DOI: 10.3389/fnins.2022.1050585.

References

Yoon J, Wang Z, Kim K, Wu H, Ravichandran V, Xia Q . An artificial nociceptor based on a diffusive memristor. Nat Commun. 2018; 9(1):417. PMC: 5788850. DOI: 10.1038/s41467-017-02572-3. View

Lee T, Hwang H, Woo J, Kim D, Kim T, Nahm S . Synaptic Plasticity and Metaplasticity of Biological Synapse Realized in a KNbO Memristor for Application to Artificial Synapse. ACS Appl Mater Interfaces. 2018; 10(30):25673-25682. DOI: 10.1021/acsami.8b04550. View

Zhu X, Du C, Jeong Y, Lu W . Emulation of synaptic metaplasticity in memristors. Nanoscale. 2016; 9(1):45-51. DOI: 10.1039/c6nr08024c. View

Boybat I, Le Gallo M, Nandakumar S, Moraitis T, Parnell T, Tuma T . Neuromorphic computing with multi-memristive synapses. Nat Commun. 2018; 9(1):2514. PMC: 6023896. DOI: 10.1038/s41467-018-04933-y. View

Serb A, Bill J, Khiat A, Berdan R, Legenstein R, Prodromakis T . Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses. Nat Commun. 2016; 7:12611. PMC: 5056401. DOI: 10.1038/ncomms12611. View

Luck S, Vogel E . The capacity of visual working memory for features and conjunctions. Nature. 1997; 390(6657):279-81. DOI: 10.1038/36846. View

Matthey L, Bays P, Dayan P . A probabilistic palimpsest model of visual short-term memory. PLoS Comput Biol. 2015; 11(1):e1004003. PMC: 4303260. DOI: 10.1371/journal.pcbi.1004003. View

Chang T, Jo S, Lu W . Short-term memory to long-term memory transition in a nanoscale memristor. ACS Nano. 2011; 5(9):7669-76. DOI: 10.1021/nn202983n. View

Zhang W, Luck S . Discrete fixed-resolution representations in visual working memory. Nature. 2008; 453(7192):233-5. PMC: 2588137. DOI: 10.1038/nature06860. View

10.

Hu S, Liu Y, Liu Z, Chen T, Wang J, Yu Q . Associative memory realized by a reconfigurable memristive Hopfield neural network. Nat Commun. 2015; 6:7522. DOI: 10.1038/ncomms8522. View

11.

Abraham W, Bear M . Metaplasticity: the plasticity of synaptic plasticity. Trends Neurosci. 1996; 19(4):126-30. DOI: 10.1016/s0166-2236(96)80018-x. View

12.

Fusi S, Drew P, Abbott L . Cascade models of synaptically stored memories. Neuron. 2005; 45(4):599-611. DOI: 10.1016/j.neuron.2005.02.001. View

13.

Bhalla U . Molecular computation in neurons: a modeling perspective. Curr Opin Neurobiol. 2014; 25:31-7. DOI: 10.1016/j.conb.2013.11.006. View

14.

Ambrogio S, Ciocchini N, Laudato M, Milo V, Pirovano A, Fantini P . Unsupervised Learning by Spike Timing Dependent Plasticity in Phase Change Memory (PCM) Synapses. Front Neurosci. 2016; 10:56. PMC: 4781832. DOI: 10.3389/fnins.2016.00056. View

15.

Wu Q, Wang H, Luo Q, Banerjee W, Cao J, Zhang X . Full imitation of synaptic metaplasticity based on memristor devices. Nanoscale. 2018; 10(13):5875-5881. DOI: 10.1039/c8nr00222c. View

16.

Benna M, Fusi S . Computational principles of synaptic memory consolidation. Nat Neurosci. 2016; 19(12):1697-1706. DOI: 10.1038/nn.4401. View

17.

Tan Z, Yang R, Terabe K, Yin X, Zhang X, Guo X . Synaptic Metaplasticity Realized in Oxide Memristive Devices. Adv Mater. 2015; 28(2):377-84. DOI: 10.1002/adma.201503575. View

18.

Ohno T, Hasegawa T, Tsuruoka T, Terabe K, Gimzewski J, Aono M . Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. Nat Mater. 2011; 10(8):591-5. DOI: 10.1038/nmat3054. View

19.

Berdan R, Vasilaki E, Khiat A, Indiveri G, Serb A, Prodromakis T . Emulating short-term synaptic dynamics with memristive devices. Sci Rep. 2016; 6:18639. PMC: 4698662. DOI: 10.1038/srep18639. View

20.

LeCun Y, Bengio Y, Hinton G . Deep learning. Nature. 2015; 521(7553):436-44. DOI: 10.1038/nature14539. View