Home LiteratureArticle Details
PMID: 19357099 Published · ppublish English Journal Article Research Support, N.I.H., Extramural Research Support, U.S. Gov't, Non-P.H.S.

CloudBurst: highly sensitive read mapping with MapReduce.

Bioinformatics (Oxford, England) ·Vol. 25 ·No. 11 ·2009-06-01 ·Pages 1363-9

Schatz MC

Abstract

Next-generation DNA sequencing machines are generating an enormous amount of sequence data, placing unprecedented demands on traditional single-processor read-mapping algorithms. CloudBurst is a new parallel read-mapping algorithm optimized for mapping next-generation sequence data to the human genome and other reference genomes, for use in a variety of biological analyses including SNP discovery, genotyping and personal genomics. It is modeled after the short read-mapping program RMAP, and reports either all alignments or the unambiguous best alignment for each read with any number of mismatches or differences. This level of sensitivity could be prohibitively time consuming, but CloudBurst uses the open-source Hadoop implementation of MapReduce to parallelize execution using multiple compute nodes. CloudBurst's running time scales linearly with the number of reads mapped, and with near linear speedup as the number of processors increases. In a 24-processor core configuration, CloudBurst is up to 30 times faster than RMAP executing on a single core, while computing an identical set of alignments. Using a larger remote compute cloud with 96 cores, CloudBurst improved performance by >100-fold, reducing the running time from hours to mere minutes for typical jobs involving mapping of millions of short reads to the human genome. CloudBurst is available open-source as a model for parallelizing algorithms with MapReduce at (http://cloudburst-bio.sourceforge.net/).

MeSH Terms
Algorithms Animals Computational Biology/methods DNA Genome Humans Internet Sequence Alignment Sequence Analysis, DNA/methods
Chemicals
DNA
Authors & Affiliations
1 authors, click to expand affiliations / ORCID
Schatz Michael C
Center for Bioinformatics and Computational Biology, University of Maryland, College Park, MD 20742, USA. [email protected]
References (14)
14 references, click to expand
  1. The complete genome of an individual by massively parallel DNA sequencing.
    Nature. 2008 Apr 17;452(7189):872-6 PMID: 18421352
  2. Ultrafast and memory-efficient alignment of short DNA sequences to the human genome.
    Genome Biol. 2009;10(3):R25 PMID: 19261174
  3. Versatile and open software for comparing large genomes.
    Genome Biol. 2004;5(2):R12 PMID: 14759262
  4. SOAP: short oligonucleotide alignment program.
    Bioinformatics. 2008 Mar 1;24(5):713-4 PMID: 18227114
  5. The diploid genome sequence of an Asian individual.
    Nature. 2008 Nov 6;456(7218):60-5 PMID: 18987735
  6. Accurate whole human genome sequencing using reversible terminator chemistry.
    Nature. 2008 Nov 6;456(7218):53-9 PMID: 18987734
  7. The sequence of the human genome.
    Science. 2001 Feb 16;291(5507):1304-51 PMID: 11181995
  8. Mapping short DNA sequencing reads and calling variants using mapping quality scores.
    Genome Res. 2008 Nov;18(11):1851-8 PMID: 18714091
  9. Identification of common molecular subsequences.
    J Mol Biol. 1981 Mar 25;147(1):195-7 PMID: 7265238
  10. ZOOM! Zillions of oligos mapped.
    Bioinformatics. 2008 Nov 1;24(21):2431-7 PMID: 18684737
  11. Next-generation sequencing outpaces expectations.
    Nat Biotechnol. 2007 Feb;25(2):149 PMID: 17287734
  12. Basic local alignment search tool.
    J Mol Biol. 1990 Oct 5;215(3):403-10 PMID: 2231712
  13. Using quality scores and longer reads improves accuracy of Solexa read mapping.
    BMC Bioinformatics. 2008 Feb 28;9:128 PMID: 18307793
  14. High-throughput sequence alignment using Graphics Processing Units.
    BMC Bioinformatics. 2007 Dec 10;8:474 PMID: 18070356
Article Info
Journal
Bioinformatics (Oxford, England)
Abbr.
Bioinformatics
ISSN
1367-4811
Published
2009-06-01
Epub
2009-00-08
Pages
1363-9
Language
English
Region
England
NLM ID
9808944
PMCID
PMC2682523
Subset
IM
Grants
NLM NIH HHS · R01 LM006845 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]