Home LiteratureArticle Details
PMID: 22796662 Published · epublish English Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, Non-P.H.S.

Wisdom of crowds for robust gene network inference.

Nature methods ·Vol. 9 ·No. 8 ·2012-07-15 ·Pages 796-804

Marbach D, Costello JC, Küffner R, Vega NM, Prill RJ, Camacho DM, Allison KR, DREAM5 Consortium, Kellis M, Collins JJ, Stolovitzky G

Abstract

Reconstructing gene regulatory networks from high-throughput data is a long-standing challenge. Through the Dialogue on Reverse Engineering Assessment and Methods (DREAM) project, we performed a comprehensive blind assessment of over 30 network inference methods on Escherichia coli, Staphylococcus aureus, Saccharomyces cerevisiae and in silico microarray data. We characterize the performance, data requirements and inherent biases of different inference approaches, and we provide guidelines for algorithm application and development. We observed that no single inference method performs optimally across all data sets. In contrast, integration of predictions from multiple inference methods shows robust and high performance across diverse data sets. We thereby constructed high-confidence networks for E. coli and S. aureus, each comprising ~1,700 transcriptional interactions at a precision of ~50%. We experimentally tested 53 previously unobserved regulatory interactions in E. coli, of which 23 (43%) were supported. Our results establish community-based methods as a powerful and robust tool for the inference of transcriptional gene regulatory networks.

MeSH Terms
Algorithms Computational Biology Escherichia coli/genetics Gene Expression Regulation, Bacterial/genetics Gene Regulatory Networks Oligonucleotide Array Sequence Analysis Saccharomyces cerevisiae/genetics Software Staphylococcus aureus/genetics Transcription, Genetic/genetics
Authors & Affiliations
11 authors, click to expand affiliations / ORCID
Marbach Daniel
Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA.
Costello James C
Küffner Robert
Vega Nicole M
Prill Robert J
Camacho Diogo M
Allison Kyle R
DREAM5 Consortium
Kellis Manolis
Collins James J
Stolovitzky Gustavo
Investigators
58 investigators, click to expand
Aderhold Andrej
Allison Kyle R
Bonneau Richard
Camacho Diogo M
Chen Yukun
Collins James J
Cordero Francesca
Costello James C
Crane Martin
Dondelinger Frank
Drton Mathias
Esposito Roberto
Foygel Rina
de la Fuente Alberto
Gertheiss Jan
Geurts Pierre
Greenfield Alex
Grzegorczyk Marco
Haury Anne-Claire
Holmes Benjamin
Hothorn Torsten
Husmeier Dirk
Huynh-Thu Vân Anh
Irrthum Alexandre
Kellis Manolis
Karlebach Guy
Küffner Robert
Lèbre Sophie
De Leo Vincenzo
Madar Aviv
Mani Subramani
Marbach Daniel
Mordelet Fantine
Ostrer Harry
Ouyang Zhengyu
Pandya Ravi
Petri Tobias
Pinna Andrea
Poultney Christopher S
Prill Robert J
Rezny Serena
Ruskin Heather J
Saeys Yvan
Shamir Ron
Sîrbu Alina
Song Mingzhou
Soranzo Nicola
Statnikov Alexander
Stolovitzky Gustavo
Vega Nicci
Vera-Licona Paola
Vert Jean-Philippe
Visconti Alessia
Wang Haizhou
Wehenkel Louis
Windhager Lukas
Zhang Yang
Zimmer Ralf
References (46)
46 references, click to expand
  1. Chemogenomic profiling on a genome-wide scale using reverse-engineered gene networks.
    Nat Biotechnol. 2005 Mar;23(3):377-83 PMID: 15765094
  2. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements.
    Pac Symp Biocomput. 2000;:418-29 PMID: 10902190
  3. Combining multiple results of a reverse-engineering algorithm: application to the DREAM five-gene network challenge.
    Ann N Y Acad Sci. 2009 Mar;1158:102-13 PMID: 19348636
  4. Revealing strengths and weaknesses of methods for gene network inference.
    Proc Natl Acad Sci U S A. 2010 Apr 6;107(14):6286-91 PMID: 20308593
  5. Advantages and limitations of current network inference methods.
    Nat Rev Microbiol. 2010 Oct;8(10):717-29 PMID: 20805835
  6. Computational discovery of gene modules and regulatory networks.
    Nat Biotechnol. 2003 Nov;21(11):1337-42 PMID: 14555958
  7. Lessons from the DREAM2 Challenges.
    Ann N Y Acad Sci. 2009 Mar;1158:159-95 PMID: 19348640
  8. Integrated biclustering of heterogeneous genome-wide datasets for the inference of global regulatory networks.
    BMC Bioinformatics. 2006 Jun 02;7:280 PMID: 16749936
  9. SIRENE: supervised inference of regulatory networks.
    Bioinformatics. 2008 Aug 15;24(16):i76-82 PMID: 18689844
  10. Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles.
    PLoS Biol. 2007 Jan;5(1):e8 PMID: 17214507
  11. Reconstructing generalized logical networks of transcriptional regulation in mouse brain from temporal gene expression data.
    EURASIP J Bioinform Syst Biol. 2009;:545176 PMID: 19300527
  12. Least absolute regression network analysis of the murine osteoblast differentiation network.
    Bioinformatics. 2006 Feb 15;22(4):477-84 PMID: 16332709
  13. DISTILLER: a data integration framework to reveal condition dependency of complex regulons in Escherichia coli.
    Genome Biol. 2009;10(3):R27 PMID: 19265557
  14. TIGRESS: Trustful Inference of Gene REgulation using Stability Selection.
    BMC Syst Biol. 2012 Nov 22;6:145 PMID: 23173819
  15. Similar network activity from disparate circuit parameters.
    Nat Neurosci. 2004 Dec;7(12):1345-52 PMID: 15558066
  16. Statistical inference of the time-varying structure of gene-regulation networks.
    BMC Syst Biol. 2010 Sep 22;4:130 PMID: 20860793
  17. An improved map of conserved regulatory sites for Saccharomyces cerevisiae.
    BMC Bioinformatics. 2006 Mar 07;7:113 PMID: 16522208
  18. GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods.
    Bioinformatics. 2011 Aug 15;27(16):2263-70 PMID: 21697125
  19. Many Microbe Microarrays Database: uniformly normalized Affymetrix compendia with structured experimental metadata.
    Nucleic Acids Res. 2008 Jan;36(Database issue):D866-70 PMID: 17932051
  20. Inferring gene regulatory networks by ANOVA.
    Bioinformatics. 2012 May 15;28(10):1376-82 PMID: 22467911
  21. ARACNE: an algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context.
    BMC Bioinformatics. 2006 Mar 20;7 Suppl 1:S7 PMID: 16723010
  22. Using Bayesian networks to analyze expression data.
    J Comput Biol. 2000;7(3-4):601-20 PMID: 11108481
  23. Analysis and computational dissection of molecular signature multiplicity.
    PLoS Comput Biol. 2010 May 20;6(5):e1000790 PMID: 20502670
  24. GenePattern 2.0.
    Nat Genet. 2006 May;38(5):500-1 PMID: 16642009
  25. Inference of regulatory gene interactions from expression data using three-way mutual information.
    Ann N Y Acad Sci. 2009 Mar;1158:302-13 PMID: 19348651
  26. Inference of the transcriptional regulatory network in Staphylococcus aureus by integration of experimental and genomics-based evidence.
    J Bacteriol. 2011 Jul;193(13):3228-40 PMID: 21531804
  27. Multiple models to capture the variability in biological neurons and networks.
    Nat Neurosci. 2011 Feb;14(2):133-8 PMID: 21270780
  28. Genetic reconstruction of a functional transcriptional regulatory network.
    Nat Genet. 2007 May;39(5):683-7 PMID: 17417638
  29. Constructing logical models of gene regulatory networks by integrating transcription factor-DNA interactions with expression data: an entropy-based approach.
    J Comput Biol. 2012 Jan;19(1):30-41 PMID: 22216865
  30. Dialogue on reverse-engineering assessment and methods: the DREAM of high-throughput pathway inference.
    Ann N Y Acad Sci. 2007 Dec;1115:1-22 PMID: 17925349
  31. Modularity and community structure in networks.
    Proc Natl Acad Sci U S A. 2006 Jun 6;103(23):8577-82 PMID: 16723398
  32. Improved reconstruction of in silico gene regulatory networks by integrating knockout and perturbation data.
    PLoS One. 2010 Jan 26;5(1):e8121 PMID: 20126643
  33. NCBI GEO: archive for functional genomics data sets--10 years on.
    Nucleic Acids Res. 2011 Jan;39(Database issue):D1005-10 PMID: 21097893
  34. Inferring regulatory networks from expression data using tree-based methods.
    PLoS One. 2010 Sep 28;5(9): PMID: 20927193
  35. DREAM4: Combining genetic and dynamic information to identify biological networks and dynamical models.
    PLoS One. 2010 Oct 25;5(10):e13397 PMID: 21049040
  36. Causal discovery using a Bayesian local causal discovery algorithm.
    Stud Health Technol Inform. 2004;107(Pt 1):731-5 PMID: 15360909
  37. A decade of CASP: progress, bottlenecks and prognosis in protein structure prediction.
    Curr Opin Struct Biol. 2005 Jun;15(3):285-9 PMID: 15939584
  38. Predictive regulatory models in Drosophila melanogaster by integrative inference of transcriptional networks.
    Genome Res. 2012 Jul;22(7):1334-49 PMID: 22456606
  39. RegulonDB version 7.0: transcriptional regulation of Escherichia coli K-12 integrated within genetic sensory response units (Gensor Units).
    Nucleic Acids Res. 2011 Jan;39(Database issue):D98-105 PMID: 21051347
  40. Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data.
    Bioinformatics. 2005 May 15;21(10):2394-402 PMID: 15713736
  41. Generating realistic in silico gene networks for performance assessment of reverse engineering methods.
    J Comput Biol. 2009 Feb;16(2):229-39 PMID: 19183003
  42. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias.
    Bioinformatics. 2003 Jan 22;19(2):185-93 PMID: 12538238
  43. Systems analysis of cellular networks under uncertainty.
    FEBS Lett. 2009 Dec 17;583(24):3923-30 PMID: 19879267
  44. Ensemble modeling for analysis of cell signaling dynamics.
    Nat Biotechnol. 2007 Sep;25(9):1001-6 PMID: 17846631
  45. Towards a rigorous assessment of systems biology models: the DREAM3 challenges.
    PLoS One. 2010 Feb 23;5(2):e9202 PMID: 20186320
  46. Transcriptional regulatory code of a eukaryotic genome.
    Nature. 2004 Sep 2;431(7004):99-104 PMID: 15343339
Article Info
Journal
Nature methods
Abbr.
Nat Methods
ISSN
1548-7105
Published
2012-07-15
Epub
2012-00-15
Pages
796-804
Language
English
Region
United States
NLM ID
101215604
PMCID
PMC3512113
Subset
IM
Grants
NIH HHS · DP1 OD003644 · United States
NCI NIH HHS · U54CA121852 · United States
Howard Hughes Medical Institute · United States
NIH HHS · DPI OD003644 · United States
NCI NIH HHS · U54 CA121852 · United States
NCI NIH HHS · U54CA132383 · United States
NHGRI NIH HHS · R01 HG004037 · United States
NCI NIH HHS · U54 CA132383 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]