Home LiteratureArticle Details
PMID: 17922568 Published · ppublish English Journal Article Research Support, N.I.H., Extramural Research Support, U.S. Gov't, Non-P.H.S.

Universally sloppy parameter sensitivities in systems biology models.

PLoS computational biology ·Vol. 3 ·No. 10 ·2007-10-00 ·Pages 1871-78

Gutenkunst RN, Waterfall JJ, Casey FP, Brown KS, Myers CR, Sethna JP

Abstract

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a "sloppy" spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.

MeSH Terms
Algorithms Computer Simulation/trends Half-Life Meta-Analysis as Topic Metabolic Networks and Pathways Models, Biological Models, Statistical Monte Carlo Method Nonlinear Dynamics Probability Sensitivity and Specificity Systems Biology/methods
Authors & Affiliations
6 authors, click to expand affiliations / ORCID
Gutenkunst Ryan N
Laboratory of Atomic and Solid State Physics, Cornell University, Ithaca, New York, USA. [email protected]
Waterfall Joshua J
Casey Fergal P
Brown Kevin S
Myers Christopher R
Sethna James P
References (40)
40 references, click to expand
  1. Globally optimised parameters for a model of mitotic control in frog egg extracts.
    Syst Biol (Stevenage). 2005 Jun;152(2):81-92 PMID: 17044236
  2. Non-linear optimization of biochemical pathways: applications to metabolic engineering and parameter estimation.
    Bioinformatics. 1998;14(10):869-83 PMID: 9927716
  3. Mechanisms of noise-resistance in genetic oscillators.
    Proc Natl Acad Sci U S A. 2002 Apr 30;99(9):5988-92 PMID: 11972055
  4. A kinetic mechanism for nicotinic acetylcholine receptors based on multiple allosteric transitions.
    Biol Cybern. 1996 Nov;75(5):361-79 PMID: 8983160
  5. A minimal cascade model for the mitotic oscillator involving cyclin and cdc2 kinase.
    Proc Natl Acad Sci U S A. 1991 Oct 15;88(20):9107-11 PMID: 1833774
  6. Statistical mechanical approaches to models with many poorly known parameters.
    Phys Rev E Stat Nonlin Soft Matter Phys. 2003 Aug;68(2 Pt 1):021904 PMID: 14525003
  7. Dynamic modeling of the central carbon metabolism of Escherichia coli.
    Biotechnol Bioeng. 2002 Jul 5;79(1):53-73 PMID: 17590932
  8. Robust oscillations within the interlocked feedback model of Drosophila circadian rhythm.
    J Theor Biol. 2001 Jun 21;210(4):401-6 PMID: 11403560
  9. Monte Carlo sampling can be used to determine the size and shape of the steady-state flux space.
    J Theor Biol. 2004 Jun 21;228(4):437-47 PMID: 15178193
  10. Model identification of signal transduction networks from data using a state regulator problem.
    Syst Biol (Stevenage). 2005 Mar;2(1):17-30 PMID: 17091579
  11. The roles of APC and Axin derived from experimental and theoretical analysis of the Wnt pathway.
    PLoS Biol. 2003 Oct;1(1):E10 PMID: 14551908
  12. Network motifs: structure does not determine function.
    BMC Genomics. 2006 May 05;7:108 PMID: 16677373
  13. Linking data to models: data regression.
    Nat Rev Mol Cell Biol. 2006 Nov;7(11):813-9 PMID: 17006434
  14. BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems.
    Nucleic Acids Res. 2006 Jan 1;34(Database issue):D689-91 PMID: 16381960
  15. Sloppy-model universality class and the Vandermonde matrix.
    Phys Rev Lett. 2006 Oct 13;97(15):150601 PMID: 17155311
  16. The intricate side of systems biology.
    Proc Natl Acad Sci U S A. 2006 Jun 20;103(25):9452-7 PMID: 16766654
  17. Can yeast glycolysis be understood in terms of in vitro kinetics of the constituent enzymes? Testing biochemistry.
    Eur J Biochem. 2000 Sep;267(17):5313-29 PMID: 10951190
  18. Characterization of binding equilibrium data by a variety of fitted isotherms.
    Eur J Biochem. 1987 Dec 15;169(3):487-95 PMID: 3691503
  19. Modeling the cell division cycle: cdc2 and cyclin interactions.
    Proc Natl Acad Sci U S A. 1991 Aug 15;88(16):7328-32 PMID: 1831270
  20. Causal protein-signaling networks derived from multiparameter single-cell data.
    Science. 2005 Apr 22;308(5721):523-9 PMID: 15845847
  21. Negative feedback and ultrasensitivity can bring about oscillations in the mitogen-activated protein kinase cascades.
    Eur J Biochem. 2000 Mar;267(6):1583-8 PMID: 10712587
  22. Mathematical models of purine metabolism in man.
    Math Biosci. 1998 Jul;151(1):1-49 PMID: 9664759
  23. Optimal experimental design in an epidermal growth factor receptor signalling and down-regulation model.
    IET Syst Biol. 2007 May;1(3):190-202 PMID: 17591178
  24. Chaos and birhythmicity in a model for circadian oscillations of the PER and TIM proteins in drosophila
    J Theor Biol. 1999 Jun 7;198(3):445-59 PMID: 10366496
  25. A hybrid approach for efficient and robust parameter estimation in biochemical pathways.
    Biosystems. 2006 Feb-Mar;83(2-3):248-65 PMID: 16236429
  26. k-Cone analysis: determining all candidate values for kinetic parameters on a network scale.
    Biophys J. 2005 Mar;88(3):1616-25 PMID: 15626710
  27. Complex biology with no parameters.
    Nat Biotechnol. 2001 Jun;19(6):503-4 PMID: 11385433
  28. Bayesian ensemble approach to error estimation of interatomic potentials.
    Phys Rev Lett. 2004 Oct 15;93(16):165501 PMID: 15525000
  29. Integrative analysis of cell cycle control in budding yeast.
    Mol Biol Cell. 2004 Aug;15(8):3841-62 PMID: 15169868
  30. A systems approach to measuring the binding energy landscapes of transcription factors.
    Science. 2007 Jan 12;315(5809):233-7 PMID: 17218526
  31. The influence of macromolecular crowding and macromolecular confinement on biochemical reactions in physiological media.
    J Biol Chem. 2001 Apr 6;276(14):10577-80 PMID: 11279227
  32. Extension of a genetic network model by iterative experimentation and mathematical analysis.
    Mol Syst Biol. 2005;1:2005.0013 PMID: 16729048
  33. The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models.
    Bioinformatics. 2003 Mar 1;19(4):524-31 PMID: 12611808
  34. The segment polarity network is a robust developmental module.
    Nature. 2000 Jul 13;406(6792):188-92 PMID: 10910359
  35. Plasticity of the cis-regulatory input function of a gene.
    PLoS Biol. 2006 Apr;4(4):e45 PMID: 16602820
  36. Physicochemical modelling of cell signalling pathways.
    Nat Cell Biol. 2006 Nov;8(11):1195-203 PMID: 17060902
  37. Computational systems biology.
    Nature. 2002 Nov 14;420(6912):206-10 PMID: 12432404
  38. The statistical mechanics of complex signaling networks: nerve growth factor signaling.
    Phys Biol. 2004 Dec;1(3-4):184-95 PMID: 16204838
  39. Prediction and validation of the distinct dynamics of transient and sustained ERK activation.
    Nat Cell Biol. 2005 Apr;7(4):365-73 PMID: 15793571
  40. Importance of input perturbations and stochastic gene expression in the reverse engineering of genetic regulatory networks: insights from an identifiability analysis of an in silico network.
    Genome Res. 2003 Nov;13(11):2396-405 PMID: 14597654
Article Info
Journal
PLoS computational biology
Abbr.
PLoS Comput Biol
ISSN
1553-7358
Published
2007-10-00
Epub
2007-00-15
Pages
1871-78
Language
English
Region
United States
NLM ID
101238922
PMCID
PMC2000971
Subset
IM
Grants
NIGMS NIH HHS · T32 GM008267 · United States
NIGMS NIH HHS · T32GM08267 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]