Comprehensive Evaluation and Characterisation of Short Read General-purpose Structural Variant Calling Software

Overview

Journal Nat Commun

Specialty Biology

Date 2019 Jul 21

PMID 31324872

Citations 129

Authors

Daniel L Cameron

Leon Di Stefano

Anthony T Papenfuss

Affiliations

Soon will be listed here.

Abstract

In recent years, many software packages for identifying structural variants (SVs) using whole-genome sequencing data have been released. When published, a new method is commonly compared with those already available, but this tends to be selective and incomplete. The lack of comprehensive benchmarking of methods presents challenges for users in selecting methods and for developers in understanding algorithm behaviours and limitations. Here we report the comprehensive evaluation of 10 SV callers, selected following a rigorous process and spanning the breadth of detection approaches, using high-quality reference cell lines, as well as simulations. Due to the nature of available truth sets, our focus is on general-purpose rather than somatic callers. We characterise the impact on performance of event size and type, sequencing characteristics, and genomic context, and analyse the efficacy of ensemble calling and calibration of variant quality scores. Finally, we provide recommendations for both users and methods developers.

Citing Articles

Unraveling MECP2 structural variants in previously elusive Rett syndrome cases through IGV interpretation.

Poleg T, Hadar N, Heimer G, Dolgin V, Aminov I, Safran A NPJ Genom Med. 2025; 10(1):23.

PMID: 40082422 PMC: 11906642. DOI: 10.1038/s41525-025-00481-9.

Systematic benchmarking of tools for structural variation detection using short- and long-read sequencing data in pigs.

He S, Song B, Tang Y, Qu X, Li X, Yang X iScience. 2025; 28(3):111983.

PMID: 40060913 PMC: 11889634. DOI: 10.1016/j.isci.2025.111983.

Investigation of a pathogenic inversion in UNC13D and comprehensive analysis of chromosomal inversions across diverse datasets.

Bozkurt-Yozgatli T, Lun M, Bengtsson J, Sezerman U, Chinn I, Coban-Akdemir Z Eur J Hum Genet. 2025; .

PMID: 40021841 DOI: 10.1038/s41431-025-01817-w.

Benchmarking, detection, and genotyping of structural variants in a population of whole-genome assemblies using the SVGAP pipeline.

Hu M, Wan P, Chen C, Tang S, Chen J, Wang L bioRxiv. 2025; .

PMID: 39975360 PMC: 11839052. DOI: 10.1101/2025.02.07.637096.

Comparisons of performances of structural variants detection algorithms in solitary or combination strategy.

Duan D, Cheng C, Huang Y, Chung A, Chen P, Chen Y PLoS One. 2025; 20(2):e0314982.

PMID: 39913463 PMC: 11801633. DOI: 10.1371/journal.pone.0314982.

References

Chen K, Wallis J, McLellan M, Larson D, Kalicki J, Pohl C . BreakDancer: an algorithm for high-resolution mapping of genomic structural variation. Nat Methods. 2009; 6(9):677-81. PMC: 3661775. DOI: 10.1038/nmeth.1363. View

Schroder J, Wirawan A, Schmidt B, Papenfuss A . CLOVE: classification of genomic fusions into structural variation events. BMC Bioinformatics. 2017; 18(1):346. PMC: 5520322. DOI: 10.1186/s12859-017-1760-3. View

Parikh H, Mohiyuddin M, Lam H, Iyer H, Chen D, Pratt M . svclassify: a method to establish benchmark structural variant calls. BMC Genomics. 2016; 17:64. PMC: 4715349. DOI: 10.1186/s12864-016-2366-2. View

Hormozdiari F, Hajirasouliha I, McPherson A, Eichler E, Sahinalp S . Simultaneous structural variation discovery among multiple paired-end sequenced genomes. Genome Res. 2011; 21(12):2203-12. PMC: 3227108. DOI: 10.1101/gr.120501.111. View

Rausch T, Zichner T, Schlattl A, Stutz A, Benes V, Korbel J . DELLY: structural variant discovery by integrated paired-end and split-read analysis. Bioinformatics. 2012; 28(18):i333-i339. PMC: 3436805. DOI: 10.1093/bioinformatics/bts378. View

Hayes M, Li J . Bellerophon: a hybrid method for detecting interchromosomal rearrangements at base pair resolution using next-generation sequencing data. BMC Bioinformatics. 2013; 14 Suppl 5:S6. PMC: 3622635. DOI: 10.1186/1471-2105-14-S5-S6. View

Sindi S, Onal S, Peng L, Wu H, Raphael B . An integrative probabilistic model for identification of structural variation in sequencing data. Genome Biol. 2012; 13(3):R22. PMC: 3439973. DOI: 10.1186/gb-2012-13-3-r22. View

Yang R, Chen L, Newman S, Gandhi K, Doho G, Moreno C . Integrated analysis of whole-genome paired-end and mate-pair sequencing data for identifying genomic structural variations in multiple myeloma. Cancer Inform. 2014; 13(Suppl 2):49-53. PMC: 4179644. DOI: 10.4137/CIN.S13783. View

Liu X, Han S, Wang Z, Gelernter J, Yang B . Variant callers for next-generation sequencing data: a comparison study. PLoS One. 2013; 8(9):e75619. PMC: 3785481. DOI: 10.1371/journal.pone.0075619. View

10.

Schroder J, Hsu A, Boyle S, Macintyre G, Cmero M, Tothill R . Socrates: identification of genomic rearrangements in tumour genomes by re-aligning soft clipped reads. Bioinformatics. 2014; 30(8):1064-1072. PMC: 3982158. DOI: 10.1093/bioinformatics/btt767. View

11.

Wang J, Mullighan C, Easton J, Roberts S, Heatley S, Ma J . CREST maps somatic structural variation in cancer genomes with base-pair resolution. Nat Methods. 2011; 8(8):652-4. PMC: 3527068. DOI: 10.1038/nmeth.1628. View

12.

Huddleston J, Chaisson M, Steinberg K, Warren W, Hoekzema K, Gordon D . Discovery and genotyping of structural variation from long-read haploid genome sequence data. Genome Res. 2016; 27(5):677-685. PMC: 5411763. DOI: 10.1101/gr.214007.116. View

13.

Ghoneim D, Myers J, Tuttle E, Paciorkowski A . Comparison of insertion/deletion calling algorithms on human next-generation sequencing data. BMC Res Notes. 2014; 7:864. PMC: 4265454. DOI: 10.1186/1756-0500-7-864. View

14.

Sudmant P, Rausch T, Gardner E, Handsaker R, Abyzov A, Huddleston J . An integrated map of structural variation in 2,504 human genomes. Nature. 2015; 526(7571):75-81. PMC: 4617611. DOI: 10.1038/nature15394. View

15.

Zhang J, Wang J, Wu Y . An improved approach for accurate and efficient calling of structural variations with low-coverage sequence data. BMC Bioinformatics. 2012; 13 Suppl 6:S6. PMC: 3358659. DOI: 10.1186/1471-2105-13-S6-S6. View

16.

Xi R, Kim T, Park P . Detecting structural variations in the human genome using next generation sequencing. Brief Funct Genomics. 2011; 9(5-6):405-15. PMC: 3080742. DOI: 10.1093/bfgp/elq025. View

17.

Iakovishina D, Janoueix-Lerosey I, Barillot E, Regnier M, Boeva V . SV-Bay: structural variant detection in cancer genomes using a Bayesian approach with correction for GC-content and read mappability. Bioinformatics. 2016; 32(7):984-92. PMC: 4896370. DOI: 10.1093/bioinformatics/btv751. View

18.

Li H, Durbin R . Fast and accurate long-read alignment with Burrows-Wheeler transform. Bioinformatics. 2010; 26(5):589-95. PMC: 2828108. DOI: 10.1093/bioinformatics/btp698. View

19.

Suzuki S, Yasuda T, Shiraishi Y, Miyano S, Nagasaki M . ClipCrop: a tool for detecting structural variations with single-base resolution using soft-clipping information. BMC Bioinformatics. 2012; 12 Suppl 14:S7. PMC: 3287472. DOI: 10.1186/1471-2105-12-S14-S7. View

20.

Zhang Z, Du J, Lam H, Abyzov A, Urban A, Snyder M . Identification of genomic indels and structural variations using split reads. BMC Genomics. 2011; 12:375. PMC: 3161018. DOI: 10.1186/1471-2164-12-375. View