Abstract
High-throughput sequencing technologies, such as the Illumina Genome Analyzer, are powerful new tools for investigating a wide range of biological and medical questions. Statistical and computational methods are key for drawing meaningful and accurate conclusions from the massive and complex datasets generated by the sequencers. We provide a detailed evaluation of statistical methods for normalization and differential expression (DE) analysis of Illumina transcriptome sequencing (mRNA-Seq) data. We compare statistical methods for detecting genes that are significantly DE between two types of biological samples and find that there are substantial differences in how the test statistics handle low-count genes. We evaluate how DE results are affected by features of the sequencing platform, such as, varying gene lengths, base-calling calibration method (with and without phi X control lane), and flow-cell/library preparation effects. We investigate the impact of the read count normalization method on DE results and show that the standard approach of scaling by total lane counts (e.g., RPKM) can bias estimates of DE. We propose more general quantile-based normalization procedures and demonstrate an improvement in DE detection. Our results have significant practical and methodological implications for the design and analysis of mRNA-Seq experiments. They highlight the importance of appropriate statistical methods for normalization and DE inference, to account for features of the sequencing platform that could impact the accuracy of results. They also reveal the need for further research in the development of statistical and computational methods for mRNA-Seq.
MeSH Terms
Computational Biology/methods
Databases, Genetic
RNA, Messenger/genetics,metabolism
Sequence Analysis, RNA/methods
Authors & Affiliations
4 authors, click to expand affiliations / ORCID
Bullard James H
Division of Biostatistics, University of California, Berkeley, Berkeley, CA, USA.
[email protected]
Purdom Elizabeth
Hansen Kasper D
Dudoit Sandrine
References (19)
19 references, click to expand
-
High-resolution mapping of copy-number alterations with massively parallel sequencing.
Nat Methods. 2009 Jan;6(1):99-103
PMID: 19043412
-
Substantial biases in ultra-short read data sets from high-throughput DNA sequencing.
Nucleic Acids Res. 2008 Sep;36(16):e105
PMID: 18660515
-
Exploration, normalization, and summaries of high density oligonucleotide array probe level data.
Biostatistics. 2003 Apr;4(2):249-64
PMID: 12925520
-
Moderated statistical tests for assessing differences in tag abundance.
Bioinformatics. 2007 Nov 1;23(21):2881-7
PMID: 17881408
-
Accurate whole human genome sequencing using reversible terminator chemistry.
Nature. 2008 Nov 6;456(7218):53-9
PMID: 18987734
-
Mapping and quantifying mammalian transcriptomes by RNA-Seq.
Nat Methods. 2008 Jul;5(7):621-8
PMID: 18516045
-
Identifying differential expression in multiple SAGE libraries: an overdispersed log-linear model approach.
BMC Bioinformatics. 2005 Jun 29;6:165
PMID: 15987513
-
Determination of tag density required for digital transcriptome analysis: application to an androgen-sensitive prostate cancer model.
Proc Natl Acad Sci U S A. 2008 Dec 23;105(51):20179-84
PMID: 19088194
-
The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements.
Nat Biotechnol. 2006 Sep;24(9):1151-61
PMID: 16964229
-
Ultrafast and memory-efficient alignment of short DNA sequences to the human genome.
Genome Biol. 2009;10(3):R25
PMID: 19261174
-
Transcript length bias in RNA-seq data confounds systems biology.
Biol Direct. 2009 Apr 16;4:14
PMID: 19371405
-
Alternative isoform regulation in human tissue transcriptomes.
Nature. 2008 Nov 27;456(7221):470-6
PMID: 18978772
-
Novel low abundance and transient RNAs in yeast revealed by tiling microarrays and ultra high-throughput sequencing are not conserved across closely related yeast species.
PLoS Genet. 2008 Dec;4(12):e1000299
PMID: 19096707
-
RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays.
Genome Res. 2008 Sep;18(9):1509-17
PMID: 18550803
-
GenomeGraphs: integrated genomic data visualization with R.
BMC Bioinformatics. 2009 Jan 06;10:2
PMID: 19123956
-
Deep sequencing-based expression analysis shows major advances in robustness, resolution and inter-lab portability over five microarray platforms.
Nucleic Acids Res. 2008 Dec;36(21):e141
PMID: 18927111
-
The transcriptional landscape of the yeast genome defined by RNA sequencing.
Science. 2008 Jun 6;320(5881):1344-9
PMID: 18451266
-
Evaluation of DNA microarray results with quantitative gene expression platforms.
Nat Biotechnol. 2006 Sep;24(9):1115-22
PMID: 16964225
-
Base-calling of automated sequencer traces using phred. II. Error probabilities.
Genome Res. 1998 Mar;8(3):186-94
PMID: 9521922