ISRES+: an Improved Evolutionary Strategy for Function Minimization to Estimate the Free Parameters of Systems Biology Models

Overview

Journal Bioinformatics

Publisher Oxford University Press

Specialty Biology

Date 2023 Jun 24

PMID 37354523

Authors

Prasad Bandodkar

Razeen Shaikh

Gregory T Reeves

Affiliations

Soon will be listed here.

Abstract

Motivation: Mathematical models in systems biology help generate hypotheses, guide experimental design, and infer the dynamics of gene regulatory networks. These models are characterized by phenomenological or mechanistic parameters, which are typically hard to measure. Therefore, efficient parameter estimation is central to model development. Global optimization techniques, such as evolutionary algorithms (EAs), are applied to estimate model parameters by inverse modeling, i.e. calibrating models by minimizing a function that evaluates a measure of the error between model predictions and experimental data. EAs estimate model parameters "fittest individuals" by generating a large population of individuals using strategies like recombination and mutation over multiple "generations." Typically, only a few individuals from each generation are used to create new individuals in the next generation. Improved Evolutionary Strategy by Stochastic Ranking (ISRES), proposed by Runnarson and Yao, is one such EA that is widely used in systems biology to estimate parameters. ISRES uses information at most from a pair of individuals in any generation to create a new population to minimize the error. In this article, we propose an efficient evolutionary strategy, ISRES+, which builds on ISRES by combining information from all individuals across the population and across all generations to develop a better understanding of the fitness landscape.

Results: ISRES+ uses the additional information generated by the algorithm during evolution to approximate the local neighborhood around the best-fit individual using linear least squares fits in one and two dimensions, enabling efficient parameter estimation. ISRES+ outperforms ISRES and results in fitter individuals with a tighter distribution over multiple runs, such that a typical run of ISRES+ estimates parameters with a higher goodness-of-fit compared with ISRES.

Availability And Implementation: Algorithm and implementation: Github-https://github.com/gtreeves/isres-plus-bandodkar-2022.

Citing Articles

Identifying effective evolutionary strategies-based protocol for uncovering reaction kinetic parameters under the effect of measurement noises.

Yeo H, Vijay V, Selvarajoo K BMC Biol. 2024; 22(1):235.

PMID: 39402553 PMC: 11476556. DOI: 10.1186/s12915-024-02019-4.

Optimal performance objectives in the highly conserved bone morphogenetic protein signaling pathway.

Shaikh R, Larson N, Kam J, Hanjaya-Putra D, Zartman J, Umulis D NPJ Syst Biol Appl. 2024; 10(1):103.

PMID: 39277657 PMC: 11401948. DOI: 10.1038/s41540-024-00430-9.

References

Jaeger J, Blagov M, Kosman D, Kozlov K, Manu , Myasnikova E . Dynamical analysis of regulatory interactions in the gap gene system of Drosophila melanogaster. Genetics. 2004; 167(4):1721-37. PMC: 1471003. DOI: 10.1534/genetics.104.027334. View

Fakhouri W, Ay A, Sayal R, Dresch J, Dayringer E, Arnosti D . Deciphering a transcriptional regulatory code: modeling short-range repression in the Drosophila embryo. Mol Syst Biol. 2010; 6:341. PMC: 2824527. DOI: 10.1038/msb.2009.97. View

Schloop A, Bandodkar P, Reeves G . Formation, interpretation, and regulation of the Drosophila Dorsal/NF-κB gradient. Curr Top Dev Biol. 2020; 137:143-191. DOI: 10.1016/bs.ctdb.2019.11.007. View

Manu , Surkova S, Spirov A, Gursky V, Janssens H, Kim A . Canalization of gene expression in the Drosophila blastoderm by gap gene cross regulation. PLoS Biol. 2009; 7(3):e1000049. PMC: 2653557. DOI: 10.1371/journal.pbio.1000049. View

Liu B, Liu Q, Yang L, Palaniappan S, Bahar I, Thiagarajan P . Innate immune memory and homeostasis may be conferred through crosstalk between the TLR3 and TLR7 pathways. Sci Signal. 2016; 9(436):ra70. PMC: 5087126. DOI: 10.1126/scisignal.aac9340. View

Maeda K, Westerhoff H, Kurata H, Boogerd F . Ranking network mechanisms by how they fit diverse experiments and deciding on 's ammonium transport and assimilation network. NPJ Syst Biol Appl. 2019; 5:14. PMC: 6461619. DOI: 10.1038/s41540-019-0091-6. View

Jostins L, Jaeger J . Reverse engineering a gene network using an asynchronous parallel evolution strategy. BMC Syst Biol. 2010; 4:17. PMC: 2850326. DOI: 10.1186/1752-0509-4-17. View

OConnell M, Reeves G . The presence of nuclear cactus in the early Drosophila embryo may extend the dynamic range of the dorsal gradient. PLoS Comput Biol. 2015; 11(4):e1004159. PMC: 4400154. DOI: 10.1371/journal.pcbi.1004159. View

Crombach A, Wotton K, Cicin-Sain D, Ashyraliyev M, Jaeger J . Efficient reverse-engineering of a developmental gene regulatory network. PLoS Comput Biol. 2012; 8(7):e1002589. PMC: 3395622. DOI: 10.1371/journal.pcbi.1002589. View

10.

Fomekong-Nanfack Y, Kaandorp J, Blom J . Efficient parameter estimation for spatio-temporal models of pattern formation: case study of Drosophila melanogaster. Bioinformatics. 2007; 23(24):3356-63. DOI: 10.1093/bioinformatics/btm433. View

11.

Ashyraliyev M, Fomekong-Nanfack Y, Kaandorp J, Blom J . Systems biology: parameter estimation for biochemical models. FEBS J. 2009; 276(4):886-902. DOI: 10.1111/j.1742-4658.2008.06844.x. View

12.

Hengenius J, Gribskov M, Rundell A, Umulis D . Making models match measurements: model optimization for morphogen patterning networks. Semin Cell Dev Biol. 2014; 35:109-23. PMC: 4378650. DOI: 10.1016/j.semcdb.2014.06.017. View

13.

Manu , Surkova S, Spirov A, Gursky V, Janssens H, Kim A . Canalization of gene expression and domain shifts in the Drosophila blastoderm by dynamical attractors. PLoS Comput Biol. 2009; 5(3):e1000303. PMC: 2646127. DOI: 10.1371/journal.pcbi.1000303. View

14.

Kanodia J, Rikhy R, Kim Y, Lund V, Delotto R, Lippincott-Schwartz J . Dynamics of the Dorsal morphogen gradient. Proc Natl Acad Sci U S A. 2009; 106(51):21707-12. PMC: 2799810. DOI: 10.1073/pnas.0912395106. View

15.

Moles C, Mendes P, Banga J . Parameter estimation in biochemical pathways: a comparison of global optimization methods. Genome Res. 2003; 13(11):2467-74. PMC: 403766. DOI: 10.1101/gr.1262503. View

16.

Liberman A, Kwon S, Vu H, Filipowicz A, Ay A, Ingram K . Circadian Clock Model Supports Molecular Link Between PER3 and Human Anxiety. Sci Rep. 2017; 7(1):9893. PMC: 5579000. DOI: 10.1038/s41598-017-07957-4. View

17.

Kozlov K, Surkova S, Myasnikova E, Reinitz J, Samsonova M . Modeling of gap gene expression in Drosophila Kruppel mutants. PLoS Comput Biol. 2012; 8(8):e1002635. PMC: 3426564. DOI: 10.1371/journal.pcbi.1002635. View

18.

Schmierer B, Hill C . TGFbeta-SMAD signal transduction: molecular specificity and functional flexibility. Nat Rev Mol Cell Biol. 2007; 8(12):970-82. DOI: 10.1038/nrm2297. View

19.

Sun J, Garibaldi J, Hodgman C . Parameter estimation using meta-heuristics in systems biology: a comprehensive review. IEEE/ACM Trans Comput Biol Bioinform. 2011; 9(1):185-202. DOI: 10.1109/TCBB.2011.63. View

20.

Schmierer B, Tournier A, Bates P, Hill C . Mathematical modeling identifies Smad nucleocytoplasmic shuttling as a dynamic signal-interpreting system. Proc Natl Acad Sci U S A. 2008; 105(18):6608-13. PMC: 2373357. DOI: 10.1073/pnas.0710134105. View