Home LiteratureArticle Details
PMID: 20167110 Published · epublish English Evaluation Study Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, Non-P.H.S.

Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments.

BMC bioinformatics ·Vol. 11 ·2010-02-18 ·Pages 94

Bullard JH, Purdom E, Hansen KD, Dudoit S

Abstract

High-throughput sequencing technologies, such as the Illumina Genome Analyzer, are powerful new tools for investigating a wide range of biological and medical questions. Statistical and computational methods are key for drawing meaningful and accurate conclusions from the massive and complex datasets generated by the sequencers. We provide a detailed evaluation of statistical methods for normalization and differential expression (DE) analysis of Illumina transcriptome sequencing (mRNA-Seq) data. We compare statistical methods for detecting genes that are significantly DE between two types of biological samples and find that there are substantial differences in how the test statistics handle low-count genes. We evaluate how DE results are affected by features of the sequencing platform, such as, varying gene lengths, base-calling calibration method (with and without phi X control lane), and flow-cell/library preparation effects. We investigate the impact of the read count normalization method on DE results and show that the standard approach of scaling by total lane counts (e.g., RPKM) can bias estimates of DE. We propose more general quantile-based normalization procedures and demonstrate an improvement in DE detection. Our results have significant practical and methodological implications for the design and analysis of mRNA-Seq experiments. They highlight the importance of appropriate statistical methods for normalization and DE inference, to account for features of the sequencing platform that could impact the accuracy of results. They also reveal the need for further research in the development of statistical and computational methods for mRNA-Seq.

MeSH Terms
Computational Biology/methods Databases, Genetic RNA, Messenger/genetics,metabolism Sequence Analysis, RNA/methods
Chemicals
RNA, Messenger
Authors & Affiliations
4 authors, click to expand affiliations / ORCID
Bullard James H
Division of Biostatistics, University of California, Berkeley, Berkeley, CA, USA. [email protected]
Purdom Elizabeth
Hansen Kasper D
Dudoit Sandrine
References (19)
19 references, click to expand
  1. High-resolution mapping of copy-number alterations with massively parallel sequencing.
    Nat Methods. 2009 Jan;6(1):99-103 PMID: 19043412
  2. Substantial biases in ultra-short read data sets from high-throughput DNA sequencing.
    Nucleic Acids Res. 2008 Sep;36(16):e105 PMID: 18660515
  3. Exploration, normalization, and summaries of high density oligonucleotide array probe level data.
    Biostatistics. 2003 Apr;4(2):249-64 PMID: 12925520
  4. Moderated statistical tests for assessing differences in tag abundance.
    Bioinformatics. 2007 Nov 1;23(21):2881-7 PMID: 17881408
  5. Accurate whole human genome sequencing using reversible terminator chemistry.
    Nature. 2008 Nov 6;456(7218):53-9 PMID: 18987734
  6. Mapping and quantifying mammalian transcriptomes by RNA-Seq.
    Nat Methods. 2008 Jul;5(7):621-8 PMID: 18516045
  7. Identifying differential expression in multiple SAGE libraries: an overdispersed log-linear model approach.
    BMC Bioinformatics. 2005 Jun 29;6:165 PMID: 15987513
  8. Determination of tag density required for digital transcriptome analysis: application to an androgen-sensitive prostate cancer model.
    Proc Natl Acad Sci U S A. 2008 Dec 23;105(51):20179-84 PMID: 19088194
  9. The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements.
    Nat Biotechnol. 2006 Sep;24(9):1151-61 PMID: 16964229
  10. Ultrafast and memory-efficient alignment of short DNA sequences to the human genome.
    Genome Biol. 2009;10(3):R25 PMID: 19261174
  11. Transcript length bias in RNA-seq data confounds systems biology.
    Biol Direct. 2009 Apr 16;4:14 PMID: 19371405
  12. Alternative isoform regulation in human tissue transcriptomes.
    Nature. 2008 Nov 27;456(7221):470-6 PMID: 18978772
  13. Novel low abundance and transient RNAs in yeast revealed by tiling microarrays and ultra high-throughput sequencing are not conserved across closely related yeast species.
    PLoS Genet. 2008 Dec;4(12):e1000299 PMID: 19096707
  14. RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays.
    Genome Res. 2008 Sep;18(9):1509-17 PMID: 18550803
  15. GenomeGraphs: integrated genomic data visualization with R.
    BMC Bioinformatics. 2009 Jan 06;10:2 PMID: 19123956
  16. Deep sequencing-based expression analysis shows major advances in robustness, resolution and inter-lab portability over five microarray platforms.
    Nucleic Acids Res. 2008 Dec;36(21):e141 PMID: 18927111
  17. The transcriptional landscape of the yeast genome defined by RNA sequencing.
    Science. 2008 Jun 6;320(5881):1344-9 PMID: 18451266
  18. Evaluation of DNA microarray results with quantitative gene expression platforms.
    Nat Biotechnol. 2006 Sep;24(9):1115-22 PMID: 16964225
  19. Base-calling of automated sequencer traces using phred. II. Error probabilities.
    Genome Res. 1998 Mar;8(3):186-94 PMID: 9521922
Article Info
Journal
BMC bioinformatics
Abbr.
BMC Bioinformatics
ISSN
1471-2105
Published
2010-02-18
Epub
2010-00-18
Pages
94
Language
English
Region
England
NLM ID
100965194
PMCID
PMC2838869
Subset
IM
Grants
NHGRI NIH HHS · U01 HG004271 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]