System for Quality-Assured Data Analysis: Flexible, Reproducible Scientific Workflows

Overview

Journal Genet Epidemiol

Specialties Genetics
Public Health

Date 2018 Dec 20

PMID 30565316

Citations 4

Authors

Jerry Fowler

Francis Anthony San Lucas

Paul Scheet

Affiliations

Soon will be listed here.

Abstract

The reproducibility of scientific processes is one of the paramount problems of bioinformatics, an engineering problem that must be addressed to perform good research. The System for Quality-Assured Data Analysis (SyQADA), described here, seeks to address reproducibility by managing many of the details of procedural bookkeeping in bioinformatics in as simple and transparent a manner as possible. SyQADA has been used by persons with backgrounds ranging from expert programmer to Unix novice, to perform and repeat dozens of diverse bioinformatics workflows on tens of thousands of samples, consuming over 80 CPU-months of computing on over 300,000 individual tasks of scores of projects on laptops, computer servers, and computing clusters. SyQADA is especially well-suited for paired-sample analyses found in cancer tumor-normal studies. SyQADA executable source code, documentation, tutorial examples, and workflows used in our lab is available from http://scheet.org/software.html.

Citing Articles

Developing a systematic approach to assessing data quality in secondary use of clinical data based on intended use.

Razzaghi H, Greenberg J, Bailey L Learn Health Syst. 2022; 6(1):e10264.

PMID: 35036548 PMC: 8753309. DOI: 10.1002/lrh2.10264.

Evaluation of serverless computing for scalable execution of a joint variant calling workflow.

John A, Muenzen K, Ausmees K PLoS One. 2021; 16(7):e0254363.

PMID: 34242357 PMC: 8270184. DOI: 10.1371/journal.pone.0254363.

Inherited causes of clonal haematopoiesis in 97,691 whole genomes.

Bick A, Weinstock J, Nandakumar S, Fulco C, Bao E, Zekavat S Nature. 2020; 586(7831):763-768.

PMID: 33057201 PMC: 7944936. DOI: 10.1038/s41586-020-2819-2.

Large-scale analysis of acquired chromosomal alterations in non-tumor samples from patients with cancer.

Jakubek Y, Chang K, Sivakumar S, Yu Y, Giordano M, Fowler J Nat Biotechnol. 2019; 38(1):90-96.

PMID: 31685958 PMC: 8082517. DOI: 10.1038/s41587-019-0297-6.

References

Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira M, Bender D . PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet. 2007; 81(3):559-75. PMC: 1950838. DOI: 10.1086/519795. View

Kuehn H, Liberzon A, Reich M, Mesirov J . Using GenePattern for gene expression analysis. Curr Protoc Bioinformatics. 2008; Chapter 7:7.12.1-7.12.39. PMC: 3893799. DOI: 10.1002/0471250953.bi0712s22. View

Korn J, Kuruvilla F, McCarroll S, Wysoker A, Nemesh J, Cawley S . Integrated genotype calling and association analysis of SNPs, common copy number polymorphisms and rare CNVs. Nat Genet. 2008; 40(10):1253-60. PMC: 2756534. DOI: 10.1038/ng.237. View

McKenna A, Hanna M, Banks E, Sivachenko A, Cibulskis K, Kernytsky A . The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data. Genome Res. 2010; 20(9):1297-303. PMC: 2928508. DOI: 10.1101/gr.107524.110. View

Goecks J, Nekrutenko A, Taylor J . Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 2010; 11(8):R86. PMC: 2945788. DOI: 10.1186/gb-2010-11-8-r86. View

Goodstadt L . Ruffus: a lightweight Python library for computational pipelines. Bioinformatics. 2010; 26(21):2778-9. DOI: 10.1093/bioinformatics/btq524. View

Li Y, Willer C, Ding J, Scheet P, Abecasis G . MaCH: using sequence and genotype data to estimate haplotypes and unobserved genotypes. Genet Epidemiol. 2010; 34(8):816-34. PMC: 3175618. DOI: 10.1002/gepi.20533. View

Cibulskis K, McKenna A, Fennell T, Banks E, DePristo M, Getz G . ContEst: estimating cross-contamination of human samples in next-generation sequencing data. Bioinformatics. 2011; 27(18):2601-2. PMC: 3167057. DOI: 10.1093/bioinformatics/btr446. View

Kallio M, Tuimala J, Hupponen T, Klemela P, Gentile M, Scheinin I . Chipster: user-friendly analysis software for microarray and other high-throughput data. BMC Genomics. 2011; 12:507. PMC: 3215701. DOI: 10.1186/1471-2164-12-507. View

10.

San Lucas F, Wang G, Scheet P, Peng B . Integrated annotation and analysis of genetic variants from next-generation sequencing studies with variant tools. Bioinformatics. 2011; 28(3):421-2. PMC: 3268240. DOI: 10.1093/bioinformatics/btr667. View

11.

Koboldt D, Zhang Q, Larson D, Shen D, McLellan M, Lin L . VarScan 2: somatic mutation and copy number alteration discovery in cancer by exome sequencing. Genome Res. 2012; 22(3):568-76. PMC: 3290792. DOI: 10.1101/gr.129684.111. View

12.

Sadedin S, Pope B, Oshlack A . Bpipe: a tool for running and managing bioinformatics pipelines. Bioinformatics. 2012; 28(11):1525-6. DOI: 10.1093/bioinformatics/bts167. View

13.

Nekrutenko A, Taylor J . Next-generation sequencing data interpretation: enhancing reproducibility and accessibility. Nat Rev Genet. 2012; 13(9):667-72. DOI: 10.1038/nrg3305. View

14.

Vattathil S, Scheet P . Haplotype-based profiling of subtle allelic imbalance with SNP arrays. Genome Res. 2012; 23(1):152-8. PMC: 3530675. DOI: 10.1101/gr.141374.112. View

15.

Friedman J, Alm E . Inferring correlation networks from genomic survey data. PLoS Comput Biol. 2012; 8(9):e1002687. PMC: 3447976. DOI: 10.1371/journal.pcbi.1002687. View

16.

Cibulskis K, Lawrence M, Carter S, Sivachenko A, Jaffe D, Sougnez C . Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples. Nat Biotechnol. 2013; 31(3):213-9. PMC: 3833702. DOI: 10.1038/nbt.2514. View

17.

Sandve G, Nekrutenko A, Taylor J, Hovig E . Ten simple rules for reproducible computational research. PLoS Comput Biol. 2013; 9(10):e1003285. PMC: 3812051. DOI: 10.1371/journal.pcbi.1003285. View

18.

Buske F, French H, Smith M, Clark S, Bauer D . NGSANE: a lightweight production informatics framework for high-throughput data analysis. Bioinformatics. 2014; 30(10):1471-2. PMC: 4016703. DOI: 10.1093/bioinformatics/btu036. View

19.

Xia R, Vattathil S, Scheet P . Identification of allelic imbalance with a statistical model for subtle genomic mosaicism. PLoS Comput Biol. 2014; 10(8):e1003765. PMC: 4148184. DOI: 10.1371/journal.pcbi.1003765. View

20.

Romero Arenas M, Fowler R, San Lucas F, Shen J, Rich T, Grubbs E . Preliminary whole-exome sequencing reveals mutations that imply common tumorigenicity pathways in multiple endocrine neoplasia type 1 patients. Surgery. 2014; 156(6):1351-7. PMC: 4822541. DOI: 10.1016/j.surg.2014.08.073. View