CD-HIT: accelerated for clustering the next-generation sequencing data

Abstract

Summary: CD-HIT is a widely used program for clustering biological sequences to reduce sequence redundancy and improve the performance of other sequence analyses. In response to the rapid increase in the amount of sequencing data produced by the next-generation sequencing technologies, we have developed a new CD-HIT program accelerated with a novel parallelization strategy and some other techniques to allow efficient clustering of such datasets. Our tests demonstrated very good speedup derived from the parallelization for up to ∼24 cores and a quasi-linear speedup for up to ∼8 cores. The enhanced CD-HIT is capable of handling very large datasets in much shorter time than previous versions. Availability: http://cd-hit.org. Contact: liwz@sdsc.edu Supplementary information: Supplementary data are available at Bioinformatics online.

Shown for reading. Its publisher allows quoting it, not republishing it.

References 11

1. 1.

   Edgar RC. Search and clustering orders of magnitude faster than BLAST. Bioinformatics. 2010;26:2460-2461.

   Not in our library10.1093/bioinformatics/btq461

2. 2.

   Li W, Godzik A. Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics. 2006;22:1658-1659.

   Not in our library10.1093/bioinformatics/btl158

3. 3.

   Li W, et al. Clustering of highly homologous sequences to reduce the size of large protein databases. Bioinformatics. 2001;17:282-283.

   Not in our library10.1093/bioinformatics/17.3.282

4. 4.

   Loong SNK, Mishra SK. Unique folding of precursor microRNAs: quantitative evidence and implications for de novo identification. RNA. 2007;13:170-187.

   Not in our library10.1261/rna.223807

5. 5.
   Artificial and natural duplicates in pyrosequencing reads of metagenomic data · 2010

   No notice
6. 6.

   Qin J, et al. A human gut microbial gene catalogue established by metagenomic sequencing. Nature. 2010;464:59-65.

   Not in our library10.1038/nature08821

7. 7.

   Rubinstein R, Fiser A. Predicting disulfide bond connectivity in proteins by correlated mutations analysis. Bioinformatics. 2008;24:498-504.

   Not in our library10.1093/bioinformatics/btm637

8. 8.

   Sun S, et al. Community cyberinfrastructure for Advanced Microbial Ecology Research and Analysis: the CAMERA resource. Nucleic Acids Res. 2011;39:D546-D551.

   Not in our library10.1093/nar/gkq1102

9. 9.

   Suzek BE, et al. UniRef: comprehensive and non-redundant UniProt reference clusters. Bioinformatics. 2007;23:1282-1288.

   Not in our library10.1093/bioinformatics/btm098

10. 10.

    Turnbaugh PJ, et al. A core gut microbiome in obese and lean twins. Nature. 2009;457:480-484.

    Not in our library10.1038/nature07540

11. 11.

    Yooseph S, et al. Gene identification and protein classification in microbial metagenomic sequence data via incremental clustering. BMC Bioinformatics. 2008;9:182.

    Not in our library10.1186/1471-2105-9-182

Cited by papers we hold 197

• Multimodal deep learning for allergenic proteins prediction · 2025
  Not checked
• Ancestral and recent bursts of transposition shaped the massive genomes of plant pathogenic rust fungi · 2025
  Not checked
• Genetic isolation and metabolic complexity of an Antarctic subglacial microbiome · 2025
  Not checked
• A pan-genome of 69 Arabidopsis thaliana accessions reveals a conserved genome structure throughout the global species range · 2024
  No notice
• Earl Grey: A Fully Automated User-Friendly Transposable Element Annotation and Analysis Pipeline · 2024
  No notice
• Purines enrich root-associated Pseudomonas and improve wild soybean growth under salt stress · 2024
  No notice
• Direct prediction of intrinsically disordered protein conformational properties from sequence · 2024
  No notice
• quarTeT: a telomere-to-telomere toolkit for gap-free genome assembly and centromeric repeat identification · 2023
  No notice
• Field plus lab experiments help identify freezing tolerance and associated genes in subtropical evergreen broadleaf trees: A case study of Camellia oleifera · 2023
  Not checked
• Discovering highly potent antimicrobial peptides with deep generative model HydrAMP · 2023
  Corrected
• Bile salt hydrolases shape the bile acid landscape and restrict Clostridioides difficile growth in the murine gut · 2023
  No notice
• A general model to predict small molecule substrates of enzymes based on machine and deep learning · 2023
  No notice
• Evaluation of AlphaFold antibody–antigen modeling with implications for improving predictive accuracy · 2023
  No notice
• Predicting multiple conformations via sequence clustering and AlphaFold2 · 2023
  No notice
• NLR receptors in plant immunity: making sense of the alphabet soup · 2023
  No notice
• The Remodeling Effects of High-Concentrate Diets on Microbial Composition and Function in the Hindgut of Dairy Cows · 2022
  Not checked
• Exploration of the Nurse Shark (Ginglymostoma cirratum) Plasma Immunoproteome Using High-Resolution LC-MS/MS · 2022
  Not checked
• Occurrence of methane-oxidizing bacteria and methanogenic archaea in earth’s cave systems—A metagenomic analysis · 2022
  Not checked
• Frequencies and characteristics of genome-wide recombination in Streptococcus agalactiae, Streptococcus pyogenes, and Streptococcus suis · 2022
  Not checked
• Changes in chemical composition, structural and functional microbiome during alfalfa (Medicago sativa) ensilage with Lactobacillus plantarum PS-8 · 2022
  Not checked

and 177 more

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.