Benchmarking of Methods for Genomic Taxonomy

Overview

Journal J Clin Microbiol

Specialty Microbiology

Date 2014 Feb 28

PMID 24574292

Citations 193

Authors

Mette V Larsen

Salvatore Cosentino

Oksana Lukjancenko

Dhany Saputra

Simon Rasmussen

Henrik Hasman

Thomas Sicheritz-Ponten

Frank M Aarestrup

David W Ussery

Ole Lund

Affiliations

Soon will be listed here.

Abstract

One of the first issues that emerges when a prokaryotic organism of interest is encountered is the question of what it is--that is, which species it is. The 16S rRNA gene formed the basis of the first method for sequence-based taxonomy and has had a tremendous impact on the field of microbiology. Nevertheless, the method has been found to have a number of shortcomings. In the current study, we trained and benchmarked five methods for whole-genome sequence-based prokaryotic species identification on a common data set of complete genomes: (i) SpeciesFinder, which is based on the complete 16S rRNA gene; (ii) Reads2Type that searches for species-specific 50-mers in either the 16S rRNA gene or the gyrB gene (for the Enterobacteraceae family); (iii) the ribosomal multilocus sequence typing (rMLST) method that samples up to 53 ribosomal genes; (iv) TaxonomyFinder, which is based on species-specific functional protein domain profiles; and finally (v) KmerFinder, which examines the number of cooccurring k-mers (substrings of k nucleotides in DNA sequence data). The performances of the methods were subsequently evaluated on three data sets of short sequence reads or draft genomes from public databases. In total, the evaluation sets constituted sequence data from more than 11,000 isolates covering 159 genera and 243 species. Our results indicate that methods that sample only chromosomal, core genes have difficulties in distinguishing closely related species which only recently diverged. The KmerFinder method had the overall highest accuracy and correctly identified from 93% to 97% of the isolates in the evaluations sets.

Citing Articles

Whole-Genome Shotgun Sequencing from Chicken Clinical Tracheal Samples for Bacterial and Novel Bacteriophage Identification.

Chrzastek K, Seal B, Kulkarni A, Kapczynski D Vet Sci. 2025; 12(2).

PMID: 40005922 PMC: 11861695. DOI: 10.3390/vetsci12020162.

Genomic diversity and evolutionary patterns of affecting farmed striped catfish () in Vietnam over 20 years.

Payne C, Phuong V, Phuoc N, Dung T, Phuoc L, Crumlish M Microb Genom. 2025; 11(2).

PMID: 39969283 PMC: 11840174. DOI: 10.1099/mgen.0.001368.

Oral colonization of antimicrobial-resistant bacteria in home health care participants and their association with oral and systemic status.

Nishihama S, Kawada-Matsuo M, Le M, Fujii A, Haruta A, Kajihara T Sci Rep. 2025; 15(1):5776.

PMID: 39962261 PMC: 11832749. DOI: 10.1038/s41598-025-90037-9.

Leclercia barmai sp. nov., isolated from worm castings of Eisenia fetida, is a urease-positive, 3-nitropropionic acid and glycerol-consuming bacterium.

Barman P, Sinha S, Chakraborty R Sci Rep. 2025; 15(1):5615.

PMID: 39955304 PMC: 11830034. DOI: 10.1038/s41598-024-78134-7.

in Common Dolphins () in Portugal-Characterization of First Isolates.

Cavaco S, Grilo M, Dias R, Nunes M, Pascoal P, Pereira M Animals (Basel). 2025; 15(3).

PMID: 39943144 PMC: 11816080. DOI: 10.3390/ani15030374.

References

Maiden M, Bygraves J, Feil E, Morelli G, Russell J, Urwin R . Multilocus sequence typing: a portable approach to the identification of clones within populations of pathogenic microorganisms. Proc Natl Acad Sci U S A. 1998; 95(6):3140-5. PMC: 19708. DOI: 10.1073/pnas.95.6.3140. View

Grabherr M, Haas B, Yassour M, Levin J, Thompson D, Amit I . Full-length transcriptome assembly from RNA-Seq data without a reference genome. Nat Biotechnol. 2011; 29(7):644-52. PMC: 3571712. DOI: 10.1038/nbt.1883. View

Bennett J, Jolley K, Earle S, Corton C, Bentley S, Parkhill J . A genomic approach to bacterial taxonomy: an examination and proposed reclassification of species within the genus Neisseria. Microbiology (Reading). 2012; 158(Pt 6):1570-1580. PMC: 3541776. DOI: 10.1099/mic.0.056077-0. View

Almeida L, Araujo R . Highlights on molecular identification of closely related species. Infect Genet Evol. 2012; 13:67-75. DOI: 10.1016/j.meegid.2012.08.011. View

Yang S, Doolittle R, Bourne P . Phylogeny determined by protein domain content. Proc Natl Acad Sci U S A. 2005; 102(2):373-8. PMC: 540256. DOI: 10.1073/pnas.0408810102. View

Tindall B, Schneider S, Lapidus A, Copeland A, Del Rio T, Nolan M . Complete genome sequence of Halomicrobium mukohataei type strain (arg-2). Stand Genomic Sci. 2011; 1(3):270-7. PMC: 3035239. DOI: 10.4056/sigs.42644. View

Kampfer P, Glaeser S . Prokaryotic taxonomy in the sequencing era--the polyphasic approach revisited. Environ Microbiol. 2011; 14(2):291-317. DOI: 10.1111/j.1462-2920.2011.02615.x. View

Kampfer P . Systematics of prokaryotes: the state of the art. Antonie Van Leeuwenhoek. 2011; 101(1):3-11. DOI: 10.1007/s10482-011-9660-4. View

Larsen M, Cosentino S, Rasmussen S, Friis C, Hasman H, Marvig R . Multilocus sequence typing of total-genome-sequenced bacteria. J Clin Microbiol. 2012; 50(4):1355-61. PMC: 3318499. DOI: 10.1128/JCM.06094-11. View

10.

Li W, Godzik A . Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics. 2006; 22(13):1658-9. DOI: 10.1093/bioinformatics/btl158. View

11.

Koser C, Ellington M, Cartwright E, Gillespie S, Brown N, Farrington M . Routine use of microbial whole genome sequencing in diagnostic and public health microbiology. PLoS Pathog. 2012; 8(8):e1002824. PMC: 3410874. DOI: 10.1371/journal.ppat.1002824. View

12.

Hasman H, Saputra D, Sicheritz-Ponten T, Lund O, Svendsen C, Frimodt-Moller N . Rapid whole-genome sequencing for detection and characterization of microorganisms directly from clinical samples. J Clin Microbiol. 2013; 52(1):139-46. PMC: 3911411. DOI: 10.1128/JCM.02452-13. View

13.

Kodama Y, Shumway M, Leinonen R . The Sequence Read Archive: explosive growth of sequencing data. Nucleic Acids Res. 2011; 40(Database issue):D54-6. PMC: 3245110. DOI: 10.1093/nar/gkr854. View

14.

Lan R, Reeves P . Escherichia coli in disguise: molecular origins of Shigella. Microbes Infect. 2002; 4(11):1125-32. DOI: 10.1016/s1286-4579(02)01637-4. View

15.

Li H, Durbin R . Fast and accurate long-read alignment with Burrows-Wheeler transform. Bioinformatics. 2010; 26(5):589-95. PMC: 2828108. DOI: 10.1093/bioinformatics/btp698. View

16.

Ludwig W, Strunk O, Westram R, Richter L, Meier H, Yadhukumar . ARB: a software environment for sequence data. Nucleic Acids Res. 2004; 32(4):1363-71. PMC: 390282. DOI: 10.1093/nar/gkh293. View

17.

Yarza P, Richter M, Peplies J, Euzeby J, Amann R, Schleifer K . The All-Species Living Tree project: a 16S rRNA-based phylogenetic tree of all sequenced type strains. Syst Appl Microbiol. 2008; 31(4):241-50. DOI: 10.1016/j.syapm.2008.07.001. View

18.

Helgason E, Okstad O, Caugant D, Johansen H, Fouet A, Mock M . Bacillus anthracis, Bacillus cereus, and Bacillus thuringiensis--one species on the basis of genetic evidence. Appl Environ Microbiol. 2000; 66(6):2627-30. PMC: 110590. DOI: 10.1128/AEM.66.6.2627-2630.2000. View

19.

Teng J, Yeung M, Yue G, Au-Yeung R, Yeung E, Fung A . In silico analysis of 16S rRNA gene sequencing based methods for identification of medically important aerobic Gram-negative bacteria. J Med Microbiol. 2011; 60(Pt 9):1281-1286. DOI: 10.1099/jmm.0.027805-0. View

20.

Jimenez G, Urdiain M, Cifuentes A, Lopez-Lopez A, Blanch A, Tamames J . Description of Bacillus toyonensis sp. nov., a novel species of the Bacillus cereus group, and pairwise genome comparisons of the species of the group by means of ANI calculations. Syst Appl Microbiol. 2013; 36(6):383-91. DOI: 10.1016/j.syapm.2013.04.008. View