Publication Bias in Animal Research Presented at the 2008 Society of Critical Care Medicine Conference

Overview

Journal BMC Res Notes

Publisher Biomed Central

Specialties Biology
General Medicine

Date 2017 Jul 8

PMID 28683761

Citations 5

Authors

Una Conradi

Ari R Joffe

Affiliations

Soon will be listed here.

Abstract

Background: To determine a direct measure of publication bias by determining subsequent full-paper publication (P) of studies reported in animal research abstracts presented at an international conference (A).

Methods: We selected 100 random (using a random-number generator) A from the 2008 Society of Critical Care Medicine Conference. Using a data collection form and study manual, we recorded methodology and result variables from A. We searched PubMed and EMBASE to June 2015, and DOAJ and Google Scholar to May 2017 to screen for subsequent P. Methodology and result variables were recorded from P to determine changes in reporting from A. Predictors of P were examined using Fisher's Exact Test.

Results: 62% (95% CI 52-71%) of studies described in A were subsequently P after a median 19 [IQR 9-33.3] months from conference presentation. Reporting of studies in A was of low quality: randomized 27% (the method of randomization and allocation concealment not described), blinded 0%, sample-size calculation stated 0%, specifying the primary outcome 26%, numbers given with denominators 6%, and stating number of animals used 47%. Only being an orally presented (vs. poster presented) A (14/16 vs. 48/84, p = 0.025) predicted P. Reporting of studies in P was of poor quality: randomized 39% (the method of randomization and allocation concealment not described), likely blinded 6%, primary outcome specified 5%, sample size calculation stated 0%, numbers given with denominators 34%, and number of animals used stated 56%. Changes in reporting from A to P occurred: from non-randomized to randomized 19%, from non-blinded to blinded 6%, from negative to positive outcomes 8%, from having to not having a stated primary outcome 16%, and from non-statistically to statistically significant findings 37%. Post-hoc, using publication data, P was predicted by having positive outcomes (published 62/62, unpublished 33/38; p = 0.003), or statistically significant results (published 58/62, unpublished 20/38; p < 0.001).

Conclusions: Only 62% (95% CI 52-71%) of animal research A are subsequently P; this was predicted by oral presentation of the A, finally having positive outcomes, and finally having statistically significant results. Publication bias is prevalent in critical care animal research.

Citing Articles

Publication rates of research projects of an internal funding program of a university medical center in Germany: A retrospective study (2004-2013).

Deutsch S, Reuter S, Rose A, Tolba R PLoS One. 2020; 15(11):e0243092.

PMID: 33253269 PMC: 7703943. DOI: 10.1371/journal.pone.0243092.

fiddle: a tool to combat publication bias by getting research out of the file drawer and into the scientific community.

Bernard R, Weissgerber T, Bobrov E, Winham S, Dirnagl U, Riedel N Clin Sci (Lond). 2020; 134(20):2729-2739.

PMID: 33111948 PMC: 7593522. DOI: 10.1042/CS20201125.

Currently prescribed drugs in the UK that could upregulate or downregulate ACE2 in COVID-19 disease: a systematic review.

Dambha-Miller H, Albasri A, Hodgson S, Wilcox C, Khan S, Islam N BMJ Open. 2020; 10(9):e040644.

PMID: 32928868 PMC: 7490921. DOI: 10.1136/bmjopen-2020-040644.

Publication rates in animal research. Extent and characteristics of published and non-published animal studies followed up at two German university medical centres.

Wieschowski S, Biernot S, Deutsch S, Glage S, Bleich A, Tolba R PLoS One. 2019; 14(11):e0223758.

PMID: 31770377 PMC: 6879110. DOI: 10.1371/journal.pone.0223758.

Adipose Tissue-Derived Stem Cell Therapy for Cavernous Nerve Injury-Induced Erectile Dysfunction in the Rat Model: A Systematic Review and Meta-Analysis Using Methodological Quality Assessment.

Park H, Jeong H, Park Y, Yim H, Ha U, Hong S Int J Stem Cells. 2019; 12(2):206-217.

PMID: 31022999 PMC: 6657942. DOI: 10.15283/ijsc18122.

References

Antonic A, Sena E, Lees J, Wills T, Skeers P, Batchelor P . Stem cell transplantation in traumatic spinal cord injury: a systematic review and meta-analysis of animal studies. PLoS Biol. 2013; 11(12):e1001738. PMC: 3866091. DOI: 10.1371/journal.pbio.1001738. View

Anglemyer A, Krauth D, Bero L . Industry sponsorship and publication bias among animal studies evaluating the effects of statins on atherosclerosis and bone outcomes: a meta-analysis. BMC Med Res Methodol. 2015; 15:12. PMC: 4353470. DOI: 10.1186/s12874-015-0008-z. View

Guyatt G, Oxman A, Montori V, Vist G, Kunz R, Brozek J . GRADE guidelines: 5. Rating the quality of evidence--publication bias. J Clin Epidemiol. 2011; 64(12):1277-82. DOI: 10.1016/j.jclinepi.2011.01.011. View

Festing M, Altman D . Guidelines for the design and statistical analysis of experiments using laboratory animals. ILAR J. 2002; 43(4):244-58. DOI: 10.1093/ilar.43.4.244. View

van der Worp H, Howells D, Sena E, Porritt M, Rewell S, OCollins V . Can animal models of disease reliably inform human studies?. PLoS Med. 2010; 7(3):e1000245. PMC: 2846855. DOI: 10.1371/journal.pmed.1000245. View

Hooijmans C, Rovers M, De Vries R, Leenaars M, Ritskes-Hoitinga M, Langendam M . SYRCLE's risk of bias tool for animal studies. BMC Med Res Methodol. 2014; 14:43. PMC: 4230647. DOI: 10.1186/1471-2288-14-43. View

Macleod M, OCollins T, Howells D, Donnan G . Pooling of animal experimental data reveals influence of study design and publication bias. Stroke. 2004; 35(5):1203-8. DOI: 10.1161/01.STR.0000125719.25853.20. View

Greek R, Rice M . Animal models and conserved processes. Theor Biol Med Model. 2012; 9:40. PMC: 3533755. DOI: 10.1186/1742-4682-9-40. View

Ludbrook J . Interim analyses of data as they accumulate in laboratory experimentation. BMC Med Res Methodol. 2003; 3:15. PMC: 194709. DOI: 10.1186/1471-2288-3-15. View

10.

Green S . Can animal data translate to innovations necessary for a new era of patient-centred and individualised healthcare? Bias in preclinical animal research. BMC Med Ethics. 2015; 16:53. PMC: 4517563. DOI: 10.1186/s12910-015-0043-7. View

11.

Song F, Parekh-Bhurke S, Hooper L, Loke Y, Ryder J, Sutton A . Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies. BMC Med Res Methodol. 2009; 9:79. PMC: 2789098. DOI: 10.1186/1471-2288-9-79. View

12.

Pedder H, Vesterinen H, Macleod M, Wardlaw J . Systematic review and meta-analysis of interventions tested in animal models of lacunar stroke. Stroke. 2014; 45(2):563-70. DOI: 10.1161/STROKEAHA.113.003128. View

13.

Sena E, van der Worp H, Howells D, Macleod M . How can we improve the pre-clinical development of drugs for stroke?. Trends Neurosci. 2007; 30(9):433-9. DOI: 10.1016/j.tins.2007.06.009. View

14.

Kwon B, Okon E, Tsai E, Beattie M, Bresnahan J, Magnuson D . A grading system to evaluate objectively the strength of pre-clinical data of acute neuroprotective therapies for clinical translation in spinal cord injury. J Neurotrauma. 2010; 28(8):1525-43. PMC: 3143387. DOI: 10.1089/neu.2010.1296. View

15.

Ter Riet G, Korevaar D, Leenaars M, Sterk P, van Noorden C, Bouter L . Publication bias in laboratory animal research: a survey on magnitude, drivers, consequences and potential solutions. PLoS One. 2012; 7(9):e43404. PMC: 3434185. DOI: 10.1371/journal.pone.0043404. View

16.

Scherer R, Langenberg P, von Elm E . Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007; (2):MR000005. DOI: 10.1002/14651858.MR000005.pub3. View

17.

Sena E, Briscoe C, Howells D, Donnan G, Sandercock P, Macleod M . Factors affecting the apparent efficacy and safety of tissue plasminogen activator in thrombotic occlusion models of stroke: systematic review and meta-analysis. J Cereb Blood Flow Metab. 2010; 30(12):1905-13. PMC: 3002882. DOI: 10.1038/jcbfm.2010.116. View

18.

Knobloch K, Yoon U, Rennekampff H, Vogt P . Quality of reporting according to the CONSORT, STROBE and Timmer instrument at the American Burn Association (ABA) annual meetings 2000 and 2008. BMC Med Res Methodol. 2011; 11:161. PMC: 3247193. DOI: 10.1186/1471-2288-11-161. View

19.

. Abstracts of the Society of Critical Care Medicine's 37th Critical Care Congress, February 2-6, 2008, Honolulu, Hawaii, USA. Crit Care Med. 2007; 35(12 Suppl):A1-289. View

20.

Horrobin D . Modern biomedical research: an internally self-consistent universe with little contact with medical reality?. Nat Rev Drug Discov. 2003; 2(2):151-4. DOI: 10.1038/nrd1012. View