Autonomous Learning of Generative Models with Chemical Reaction Network Ensembles

Overview

Journal J R Soc Interface

Date 2025 Jan 21

PMID 39837479

Authors

William Poole

Thomas E Ouldridge

Manoj Gopalkrishnan

Affiliations

Soon will be listed here.

Abstract

Can a micron-sized sack of interacting molecules autonomously learn an internal model of a complex and fluctuating environment? We draw insights from control theory, machine learning theory, chemical reaction network theory and statistical physics to develop a general architecture whereby a broad class of chemical systems can autonomously learn complex distributions. Our construction takes the form of a chemical implementation of machine learning's optimization workhorse: gradient descent on the relative entropy cost function, which we demonstrate can be viewed as a form of integral feedback control. We show how this method can be applied to optimize any detailed balanced chemical reaction network and that the construction is capable of using hidden units to learn complex distributions.

Citing Articles

Temporal Contrastive Learning through implicit non-equilibrium memory.

Falk M, Strupp A, Scellier B, Murugan A Nat Commun. 2025; 16(1):2163.

PMID: 40038254 PMC: 11880436. DOI: 10.1038/s41467-025-57043-x.

Autonomous learning of generative models with chemical reaction network ensembles.

Poole W, Ouldridge T, Gopalkrishnan M J R Soc Interface. 2025; 22(222):20240373.

PMID: 39837479 PMC: 11771824. DOI: 10.1098/rsif.2024.0373.

References

Kaern M, Elston T, Blake W, Collins J . Stochasticity in gene expression: from theories to phenotypes. Nat Rev Genet. 2005; 6(6):451-64. DOI: 10.1038/nrg1615. View

Khammash M . An engineering viewpoint on biological robustness. BMC Biol. 2016; 14:22. PMC: 4804522. DOI: 10.1186/s12915-016-0241-x. View

Dupin A, Simmel F . Signalling and differentiation in emulsion-based multi-compartmentalized in vitro gene circuits. Nat Chem. 2018; 11(1):32-39. PMC: 6298583. DOI: 10.1038/s41557-018-0174-9. View

El-Samad H, Goff J, Khammash M . Calcium homeostasis and parturient hypocalcemia: an integral feedback perspective. J Theor Biol. 2002; 214(1):17-29. DOI: 10.1006/jtbi.2001.2422. View

Dussutour A . Learning in single cell organisms. Biochem Biophys Res Commun. 2021; 564:92-102. DOI: 10.1016/j.bbrc.2021.02.018. View

Arredondo D, Lakin M . Operant conditioning of stochastic chemical reaction networks. PLoS Comput Biol. 2022; 18(11):e1010676. PMC: 9718418. DOI: 10.1371/journal.pcbi.1010676. View

Stelling J, Sauer U, Szallasi Z, Doyle 3rd F, Doyle J . Robustness of cellular functions. Cell. 2004; 118(6):675-85. DOI: 10.1016/j.cell.2004.09.008. View

Nagipogu R, Fu D, Reif J . A survey on molecular-scale learning systems with relevance to DNA computing. Nanoscale. 2023; 15(17):7676-7694. DOI: 10.1039/d2nr06202j. View

GARDNER T, Cantor C, Collins J . Construction of a genetic toggle switch in Escherichia coli. Nature. 2000; 403(6767):339-42. DOI: 10.1038/35002131. View

10.

Kilner J, Friston K, Frith C . Predictive coding: an account of the mirror neuron system. Cogn Process. 2007; 8(3):159-66. PMC: 2649419. DOI: 10.1007/s10339-007-0170-2. View

11.

Davies K . Adaptive homeostasis. Mol Aspects Med. 2016; 49:1-7. PMC: 4868097. DOI: 10.1016/j.mam.2016.04.007. View

12.

Banda P, Teuscher C, Lakin M . Online learning in a chemical perceptron. Artif Life. 2013; 19(2):195-219. DOI: 10.1162/ARTL_a_00105. View

13.

Anderson D, Craciun G, Kurtz T . Product-form stationary distributions for deficiency zero chemical reaction networks. Bull Math Biol. 2010; 72(8):1947-70. DOI: 10.1007/s11538-010-9517-4. View

14.

Barkai N, Leibler S . Robustness in simple biochemical networks. Nature. 1997; 387(6636):913-7. DOI: 10.1038/43199. View

15.

Gillespie D . Stochastic simulation of chemical kinetics. Annu Rev Phys Chem. 2006; 58:35-55. DOI: 10.1146/annurev.physchem.58.032806.104637. View

16.

Fernando C, Liekens A, Bingle L, Beck C, Lenser T, Stekel D . Molecular circuits for associative learning in single-celled organisms. J R Soc Interface. 2008; 6(34):463-9. PMC: 2582189. DOI: 10.1098/rsif.2008.0344. View

17.

Qian L, Winfree E, Bruck J . Neural network computation with DNA strand displacement cascades. Nature. 2011; 475(7356):368-72. DOI: 10.1038/nature10262. View

18.

Miller M, Bassler B . Quorum sensing in bacteria. Annu Rev Microbiol. 2001; 55:165-99. DOI: 10.1146/annurev.micro.55.1.165. View

19.

Khammash M . Perfect adaptation in biology. Cell Syst. 2021; 12(6):509-521. DOI: 10.1016/j.cels.2021.05.020. View

20.

Schmiedl T, Seifert U . Stochastic thermodynamics of chemical reaction networks. J Chem Phys. 2007; 126(4):044101. DOI: 10.1063/1.2428297. View