Reproducibility of Biomedical Research - The Importance of Editorial Vigilance

Overview

Journal Biomol Detect Quantif

Date 2017 Mar 24

PMID 28331813

Citations 7

Authors

Stephen A Bustin

Jim F Huggett

Affiliations

Soon will be listed here.

Abstract

Many journal editors are a failing to implement their own authors' instructions, resulting in the publication of many articles that do not meet basic standards of transparency, employ unsuitable data analysis methods and report overly optimistic conclusions. This problem is particularly acute where quantitative measurements are made and results in the publication of papers that lack scientific rigor and contributes to the concerns with regard to the reproducibility of biomedical research. This hampers research areas such as biomarker identification, as reproducing all but the most striking changes is challenging and translation to patient care rare.

Citing Articles

Optimized bacterial absolute quantification method by qPCR using an exogenous bacterial culture as a normalization strategy in triple-species BV-like biofilms.

Lameira I, Pinto A, Lima A, Muzny C, Cerca N J Microbiol Methods. 2024; 219:106895.

PMID: 38331102 PMC: 11149788. DOI: 10.1016/j.mimet.2024.106895.

Development of Human Rhinovirus RNA Reference Material Using Digital PCR.

Ju D, Park D, Kim I, Kim S, Yoo H Genes (Basel). 2023; 14(12).

PMID: 38137032 PMC: 10742479. DOI: 10.3390/genes14122210.

Mathematical Modeling of Plasticity and Heterogeneity in EMT.

Tripathi S, Xing J, Levine H, Jolly M Methods Mol Biol. 2020; 2179:385-413.

PMID: 32939734 PMC: 8178376. DOI: 10.1007/978-1-0716-0779-4_28.

The use of digital pathology and image analysis in clinical trials.

Pell R, Oien K, Robinson M, Pitman H, Rajpoot N, Rittscher J J Pathol Clin Res. 2019; 5(2):81-90.

PMID: 30767396 PMC: 6463857. DOI: 10.1002/cjp2.127.

Priorities to Overcome Barriers Impacting Data Science Application in Emergency Care Research.

Puskarich M, Callaway C, Silbergleit R, Pines J, Obermeyer Z, Wright D Acad Emerg Med. 2018; 26(1):97-105.

PMID: 30019795 PMC: 6637965. DOI: 10.1111/acem.13520.

References

Begley C, Ioannidis J . Reproducibility in science: improving the standard for basic and preclinical research. Circ Res. 2015; 116(1):116-26. DOI: 10.1161/CIRCRESAHA.114.303819. View

Rao X, Huang X, Zhou Z, Lin X . An improvement of the 2ˆ(-delta delta CT) method for quantitative real-time polymerase chain reaction data analysis. Biostat Bioinforma Biomath. 2015; 3(3):71-85. PMC: 4280562. View

. Raising standards. Nat Struct Mol Biol. 2013; 20(5):533. DOI: 10.1038/nsmb.2590. View

Ioannidis J, Ntzani E, Trikalinos T, Contopoulos-Ioannidis D . Replication validity of genetic association studies. Nat Genet. 2001; 29(3):306-9. DOI: 10.1038/ng749. View

. Journals unite for reproducibility. Nature. 2014; 515(7525):7. DOI: 10.1038/515007a. View

Nolan T, Hands R, Bustin S . Quantification of mRNA using real-time RT-PCR. Nat Protoc. 2007; 1(3):1559-82. DOI: 10.1038/nprot.2006.236. View

Bustin S . The reproducibility of biomedical research: Sleepers awake!. Biomol Detect Quantif. 2016; 2:35-42. PMC: 5121206. DOI: 10.1016/j.bdq.2015.01.002. View

Stahlberg A, Kubista M, Pfaffl M . Comparison of reverse transcriptases in gene expression analysis. Clin Chem. 2004; 50(9):1678-80. DOI: 10.1373/clinchem.2004.035469. View

Vermeulen J, De Preter K, Lefever S, Nuytens J, De Vloed F, Derveaux S . Measurable impact of RNA quality on gene expression results from quantitative PCR. Nucleic Acids Res. 2011; 39(9):e63. PMC: 3089491. DOI: 10.1093/nar/gkr065. View

10.

. Raising standards. Nat Immunol. 2013; 14(5):415. DOI: 10.1038/ni.2603. View

11.

Bustin S . Absolute quantification of mRNA using real-time reverse transcription polymerase chain reaction assays. J Mol Endocrinol. 2000; 25(2):169-93. DOI: 10.1677/jme.0.0250169. View

12.

Alemayehu S, Feghali K, Cowden J, Komisar J, Ockenhouse C, Kamau E . Comparative evaluation of published real-time PCR assays for the detection of malaria following MIQE guidelines. Malar J. 2013; 12:277. PMC: 3750446. DOI: 10.1186/1475-2875-12-277. View

13.

Mullane K, Williams M . Unknown unknowns in biomedical research: does an inability to deal with ambiguity contribute to issues of irreproducibility?. Biochem Pharmacol. 2015; 97(2):133-6. DOI: 10.1016/j.bcp.2015.07.002. View

14.

. Raising standards. Nat Neurosci. 2013; 16(5):517. DOI: 10.1038/nn.3391. View

15.

Bustin S, Benes V, Garson J, Hellemans J, Huggett J, Kubista M . The need for transparency and good practices in the qPCR literature. Nat Methods. 2013; 10(11):1063-7. DOI: 10.1038/nmeth.2697. View

16.

Markovic O, Markovic N . Cell cross-contamination in cell cultures: the silent and neglected danger. In Vitro Cell Dev Biol Anim. 1998; 34(1):1-8. DOI: 10.1007/s11626-998-0040-y. View

17.

Bustin S, Mueller R . Real-time reverse transcription PCR (qRT-PCR) and its potential use in clinical diagnosis. Clin Sci (Lond). 2005; 109(4):365-79. DOI: 10.1042/CS20050086. View

18.

Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A . Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol. 2002; 3(7):RESEARCH0034. PMC: 126239. DOI: 10.1186/gb-2002-3-7-research0034. View

19.

Bustin S, Benes V, Garson J, Hellemans J, Huggett J, Kubista M . The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009; 55(4):611-22. DOI: 10.1373/clinchem.2008.112797. View

20.

Pfaffl M, Horgan G, Dempfle L . Relative expression software tool (REST) for group-wise comparison and statistical analysis of relative expression results in real-time PCR. Nucleic Acids Res. 2002; 30(9):e36. PMC: 113859. DOI: 10.1093/nar/30.9.e36. View