Home LiteratureArticle Details
PMID: 22985019 Published · epublish English Journal Article Research Support, Non-U.S. Gov't

Efficient experimental design and analysis strategies for the detection of differential expression using RNA-Sequencing.

BMC genomics ·Vol. 13 ·2012-09-17 ·Pages 484

Robles JA, Qureshi SE, Stephen SJ, Wilson SR, Burden CJ, Taylor JM

Abstract

RNA sequencing (RNA-Seq) has emerged as a powerful approach for the detection of differential gene expression with both high-throughput and high resolution capabilities possible depending upon the experimental design chosen. Multiplex experimental designs are now readily available, these can be utilised to increase the numbers of samples or replicates profiled at the cost of decreased sequencing depth generated per sample. These strategies impact on the power of the approach to accurately identify differential expression. This study presents a detailed analysis of the power to detect differential expression in a range of scenarios including simulated null and differential expression distributions with varying numbers of biological or technical replicates, sequencing depths and analysis methods. Differential and non-differential expression datasets were simulated using a combination of negative binomial and exponential distributions derived from real RNA-Seq data. These datasets were used to evaluate the performance of three commonly used differential expression analysis algorithms and to quantify the changes in power with respect to true and false positive rates when simulating variations in sequencing depth, biological replication and multiplex experimental design choices. This work quantitatively explores comparisons between contemporary analysis tools and experimental design choices for the detection of differential expression using RNA-Seq. We found that the DESeq algorithm performs more conservatively than edgeR and NBPSeq. With regard to testing of various experimental designs, this work strongly suggests that greater power is gained through the use of biological replicates relative to library (technical) replicates and sequencing depth. Strikingly, sequencing depth could be reduced as low as 15% without substantial impacts on false positive or true positive rates.

MeSH Terms
Algorithms Gene Expression Profiling/methods Sequence Analysis, RNA/methods Statistics as Topic/methods
Authors & Affiliations
6 authors, click to expand affiliations / ORCID
Robles José A
CSIRO Plant Industry, Black Mountain Laboratories, Canberra, Australia.
Qureshi Sumaira E
Stephen Stuart J
Wilson Susan R
Burden Conrad J
Taylor Jennifer M
References (42)
42 references, click to expand
  1. GC-content normalization for RNA-Seq data.
    BMC Bioinformatics. 2011 Dec 17;12:480 PMID: 22177264
  2. A powerful and flexible approach to the analysis of RNA sequence count data.
    Bioinformatics. 2011 Oct 1;27(19):2672-8 PMID: 21810900
  3. Differential expression--the next generation and beyond.
    Brief Funct Genomics. 2012 Jan;11(1):57-62 PMID: 22210853
  4. Why barcode? High-throughput multiplex sequencing of mitochondrial genomes for molecular systematics.
    Nucleic Acids Res. 2010 Nov;38(21):e197 PMID: 20876691
  5. A comparison of statistical methods for detecting differentially expressed genes from RNA-seq data.
    Am J Bot. 2012 Feb;99(2):248-56 PMID: 22268221
  6. From RNA-seq reads to differential expression results.
    Genome Biol. 2010;11(12):220 PMID: 21176179
  7. Evaluation of the coverage and depth of transcriptome by RNA-Seq in chickens.
    BMC Bioinformatics. 2011 Oct 18;12 Suppl 10:S5 PMID: 22165852
  8. Cloud-scale RNA-sequencing differential expression analysis with Myrna.
    Genome Biol. 2010;11(8):R83 PMID: 20701754
  9. Improving RNA-Seq expression estimates by correcting for fragment bias.
    Genome Biol. 2011;12(3):R22 PMID: 21410973
  10. Barcoding bias in high-throughput multiplex sequencing of miRNA.
    Genome Res. 2011 Sep;21(9):1506-11 PMID: 21750102
  11. Designing deep sequencing experiments: detecting structural variation and estimating transcript abundance.
    BMC Genomics. 2010 Jun 18;11:385 PMID: 20565853
  12. Understanding mechanisms underlying human gene expression variation with RNA sequencing.
    Nature. 2010 Apr 1;464(7289):768-72 PMID: 20220758
  13. Highly-multiplexed barcode sequencing: an efficient method for parallel analysis of pooled samples.
    Nucleic Acids Res. 2010 Jul;38(13):e142 PMID: 20460461
  14. A novel approach to detect differentially expressed genes from count-based digital databases by normalizing with housekeeping genes.
    Genomics. 2009 Sep;94(3):211-6 PMID: 19446020
  15. Differential expression in RNA-seq: a matter of depth.
    Genome Res. 2011 Dec;21(12):2213-23 PMID: 21903743
  16. Design and validation issues in RNA-seq experiments.
    Brief Bioinform. 2011 May;12(3):280-7 PMID: 21498551
  17. Multiplex amplification of large sets of human exons.
    Nat Methods. 2007 Nov;4(11):931-6 PMID: 17934468
  18. Deep surveying of alternative splicing complexity in the human transcriptome by high-throughput sequencing.
    Nat Genet. 2008 Dec;40(12):1413-5 PMID: 18978789
  19. Transcript length bias in RNA-seq data confounds systems biology.
    Biol Direct. 2009 Apr 16;4:14 PMID: 19371405
  20. Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation.
    Nat Biotechnol. 2010 May;28(5):511-5 PMID: 20436464
  21. Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments.
    BMC Bioinformatics. 2010 Feb 18;11:94 PMID: 20167110
  22. Quantitative miRNA expression analysis: comparing microarrays with next-generation sequencing.
    RNA. 2009 Nov;15(11):2028-34 PMID: 19745027
  23. Substantial biases in ultra-short read data sets from high-throughput DNA sequencing.
    Nucleic Acids Res. 2008 Sep;36(16):e105 PMID: 18660515
  24. Characterization and improvement of RNA-Seq precision in quantitative transcript expression profiling.
    Bioinformatics. 2011 Jul 1;27(13):i383-91 PMID: 21685096
  25. RNA-seq: technical variability and sampling.
    BMC Genomics. 2011 Jun 06;12:293 PMID: 21645359
  26. A low-cost library construction protocol and data analysis pipeline for Illumina-based strand-specific multiplex RNA-seq.
    PLoS One. 2011;6(10):e26426 PMID: 22039485
  27. A scaling normalization method for differential expression analysis of RNA-seq data.
    Genome Biol. 2010;11(3):R25 PMID: 20196867
  28. Moderated statistical tests for assessing differences in tag abundance.
    Bioinformatics. 2007 Nov 1;23(21):2881-7 PMID: 17881408
  29. Differential expression analysis for sequence count data.
    Genome Biol. 2010;11(10):R106 PMID: 20979621
  30. RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome.
    BMC Bioinformatics. 2011 Aug 04;12:323 PMID: 21816040
  31. RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays.
    Genome Res. 2008 Sep;18(9):1509-17 PMID: 18550803
  32. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data.
    Bioinformatics. 2010 Jan 1;26(1):139-40 PMID: 19910308
  33. Evaluation of DNA microarray results with quantitative gene expression platforms.
    Nat Biotechnol. 2006 Sep;24(9):1115-22 PMID: 16964225
  34. Advancing RNA-Seq analysis.
    Nat Biotechnol. 2010 May;28(5):421-3 PMID: 20458303
  35. Ab initio reconstruction of cell type-specific transcriptomes in mouse reveals the conserved multi-exonic structure of lincRNAs.
    Nat Biotechnol. 2010 May;28(5):503-10 PMID: 20436462
  36. Biases in Illumina transcriptome sequencing caused by random hexamer priming.
    Nucleic Acids Res. 2010 Jul;38(12):e131 PMID: 20395217
  37. Mapping and quantifying mammalian transcriptomes by RNA-Seq.
    Nat Methods. 2008 Jul;5(7):621-8 PMID: 18516045
  38. RNA-seq analysis of gene expression and alternative splicing by double-random priming strategy.
    Methods Mol Biol. 2011;729:247-55 PMID: 21365495
  39. Local and global factors affecting RNA sequencing analysis.
    Anal Biochem. 2011 Dec 15;419(2):317-22 PMID: 21889483
  40. Bias detection and correction in RNA-Sequencing data.
    BMC Bioinformatics. 2011 Jul 19;12:290 PMID: 21771300
  41. FDM: a graph-based statistical method to detect differential transcription using RNA-seq data.
    Bioinformatics. 2011 Oct 1;27(19):2633-40 PMID: 21824971
  42. VennDiagram: a package for the generation of highly-customizable Venn and Euler diagrams in R.
    BMC Bioinformatics. 2011 Jan 26;12:35 PMID: 21269502
Article Info
Journal
BMC genomics
Abbr.
BMC Genomics
ISSN
1471-2164
Published
2012-09-17
Epub
2012-00-17
Pages
484
Language
English
Region
England
NLM ID
100965258
PMCID
PMC3560154
Subset
IM
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]