Quality of Reporting of Complex Healthcare Interventions and Applicability of the CReDECI List - a Survey of Publications Indexed in PubMed

Overview

Journal BMC Med Res Methodol

Publisher Biomed Central

Specialties General Medicine
Health Services

Date 2013 Oct 22

PMID 24138207

Citations 8

Authors

Ralph Mohler

Gabriele Bartoszek

Gabriele Meyer

Affiliations

Soon will be listed here.

Abstract

Background: The development and evaluation of complex interventions in healthcare has obtained increased awareness. The Medical Research Council's (MRC) framework for the development and evaluation of complex interventions and its update offers guidance for researchers covering the phases development, feasibility/piloting, and evaluation. Comprehensive reporting of complex interventions enhances transparency and is essential for researchers and policy-makers. Recently, a set of 16 criteria for reporting complex interventions in healthcare (CReDECI) was published. The aim of this study is to evaluate the reporting quality in publications of complex interventions adhering to either the first or the updated MRC framework, and to evaluate the applicability of CReDECI.

Methods: A systematic PubMed search was conducted. Two reviewers independently checked titles and abstracts for inclusion. Trials on complex interventions adhering to the MRC framework and including an evaluation study in English and German were included. For all included trials and for all publications which reported on phases prior to the evaluation study, related publications were identified via forward citation tracking. The quality of reporting was assessed independently by two reviewers using CReDECI. Inter-rater agreement and time needed to complete the assessment were determined.

Results: Twenty-six publications on eight trials were included. The number of publications per trial ranged from 1 to 6 (mean 3.25). The trials demonstrate a good reporting quality for the criteria referring to the development and feasibility/piloting. For the criteria addressing the introduction of the intervention and the evaluation, quality of reporting varied widely. Two trials fulfilled 7 and 8 items respectively, five trials fulfilled one to five items and one trial offered no information on any item. The mean number of items with differing ratings per trial was two. The time needed to rate a trial ranged from 30 to 90 minutes, depending on the number of publications.

Conclusions: Adherence to the MRC framework seems to have a positive impact on the reporting quality on the development and piloting of complex interventions. Reporting on the evaluation could be improved. CReDECI is a practical instrument to check the reporting quality of complex interventions and could be used alongside design-specific reporting guidelines.

Citing Articles

Guidance for conducting feasibility and pilot studies for implementation trials.

Pearson N, Naylor P, Ashe M, Fernandez M, Yoong S, Wolfenden L Pilot Feasibility Stud. 2020; 6(1):167.

PMID: 33292770 PMC: 7603668. DOI: 10.1186/s40814-020-00634-w.

Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance.

Hallingberg B, Turley R, Segrott J, Wight D, Craig P, Moore L Pilot Feasibility Stud. 2018; 4:104.

PMID: 29854417 PMC: 5971430. DOI: 10.1186/s40814-018-0290-8.

Using intervention mapping to develop a theory-driven, group-based complex intervention to support self-management of osteoarthritis and low back pain (SOLAS).

Hurley D, Murphy L, Hayes D, Hall A, Toomey E, McDonough S Implement Sci. 2016; 11:56.

PMID: 27113575 PMC: 4845501. DOI: 10.1186/s13012-016-0418-2.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

Kagesten A, Tuncalp Z, Ali M, Chandra-Mouli V, Tran N, Gulmezoglu A PLoS One. 2015; 10(9):e0138647.

PMID: 26418859 PMC: 4852887. DOI: 10.1371/journal.pone.0138647.

The impact of physician-nurse task shifting in primary care on the course of disease: a systematic review.

Martinez-Gonzalez N, Tandjung R, Djalali S, Rosemann T Hum Resour Health. 2015; 13:55.

PMID: 26149447 PMC: 4493821. DOI: 10.1186/s12960-015-0049-8.

References

Klinkhammer-Schalke M, Koller M, Wyatt J, Steinger B, Ehret C, Ernst B . Quality of life diagnosis and therapy as complex intervention for improvement of health in breast cancer patients: delineating the conceptual, methodological, and logistic requirements (modeling). Langenbecks Arch Surg. 2007; 393(1):1-12. DOI: 10.1007/s00423-007-0210-5. View

Sharpe M, Strong V, Allen K, Rush R, Maguire P, House A . Management of major depression in outpatients attending a cancer centre: a preliminary evaluation of a multicomponent cancer nurse-delivered intervention. Br J Cancer. 2004; 90(2):310-3. PMC: 2410153. DOI: 10.1038/sj.bjc.6601546. View

Gillespie P, OShea E, Paul G, ODowd T, Smith S . Cost effectiveness of peer support for type 2 diabetes. Int J Technol Assess Health Care. 2012; 28(1):3-11. DOI: 10.1017/S0266462311000663. View

Oakley A, Strange V, Bonell C, Allen E, Stephenson J . Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006; 332(7538):413-6. PMC: 1370978. DOI: 10.1136/bmj.332.7538.413. View

Mohler R, Richter T, Kopke S, Meyer G . Interventions for preventing and reducing the use of physical restraints in long-term geriatric care - a Cochrane review. J Clin Nurs. 2012; 21(21-22):3070-81. DOI: 10.1111/j.1365-2702.2012.04153.x. View

Smith S, Paul G, Kelly A, Whitford D, OShea E, ODowd T . Peer support for patients with type 2 diabetes: cluster randomised controlled trial. BMJ. 2011; 342:d715. PMC: 3039437. DOI: 10.1136/bmj.d715. View

Avery A, Rodgers S, Cantrill J, Armstrong S, Elliott R, Howard R . Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices. Trials. 2009; 10:28. PMC: 2685134. DOI: 10.1186/1745-6215-10-28. View

Murphy A, Cupples M, Smith S, Byrne M, Leathem C, Byrne M . The SPHERE Study. Secondary prevention of heart disease in general practice: protocol of a randomised controlled trial of tailored practice and patient care plans with parallel qualitative, economic and policy analyses. [ISRCTN24081411]. Curr Control Trials Cardiovasc Med. 2005; 6:11. PMC: 1208929. DOI: 10.1186/1468-6708-6-11. View

Corrrigan M, Cupples M, Smith S, Byrne M, Leathem C, Clerkin P . The contribution of qualitative research in designing a complex intervention for secondary prevention of coronary heart disease in two different healthcare systems. BMC Health Serv Res. 2006; 6:90. PMC: 1543625. DOI: 10.1186/1472-6963-6-90. View

10.

Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B . Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013; 14:15. PMC: 3600672. DOI: 10.1186/1745-6215-14-15. View

11.

Bower P, Gilbody S, Richards D, Fletcher J, Sutton A . Collaborative care for depression in primary care. Making sense of a complex intervention: systematic review and meta-regression. Br J Psychiatry. 2006; 189:484-93. DOI: 10.1192/bjp.bp.106.023655. View

12.

Wolfe C, Redfern J, Rudd A, Grieve A, Heuschmann P, McKevitt C . Cluster randomized controlled trial of a patient and general practitioner intervention to improve the management of multiple risk factors after stroke: stop stroke. Stroke. 2010; 41(11):2470-6. DOI: 10.1161/STROKEAHA.110.588046. View

13.

Mayo-Wilson E . Reporting implementation in randomized trials: proposed additions to the consolidated standards of reporting trials statement. Am J Public Health. 2007; 97(4):630-3. PMC: 1829360. DOI: 10.2105/AJPH.2006.094169. View

14.

Wells M, Williams B, Treweek S, Coyle J, Taylor J . Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012; 13:95. PMC: 3475073. DOI: 10.1186/1745-6215-13-95. View

15.

Faes M, Reelick M, Esselink R, Rikkert M . Developing and evaluating complex healthcare interventions in geriatrics: the use of the medical research council framework exemplified on a complex fall prevention intervention. J Am Geriatr Soc. 2010; 58(11):2212-21. DOI: 10.1111/j.1532-5415.2010.03108.x. View

16.

Byrne M, Cupples M, Smith S, Leathem C, Corrigan M, Byrne M . Development of a complex intervention for secondary prevention of coronary heart disease in primary care using the UK Medical Research Council framework. Am J Manag Care. 2006; 12(5):261-6. View

17.

Hawe P, Shiell A, Riley T, Gold L . Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J Epidemiol Community Health. 2004; 58(9):788-93. PMC: 1732876. DOI: 10.1136/jech.2003.014415. View

18.

Murphy A, Cupples M, Smith S, Byrne M, Byrne M, Newell J . Effect of tailored practice and patient care plans on secondary prevention of heart disease in general practice: cluster randomised controlled trial. BMJ. 2009; 339:b4220. PMC: 2770592. DOI: 10.1136/bmj.b4220. View

19.

Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M . Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008; 337:a1655. PMC: 2769032. DOI: 10.1136/bmj.a1655. View

20.

Thompson C, Stapley S . Do educational interventions improve nurses' clinical decision making and judgement? A systematic review. Int J Nurs Stud. 2011; 48(7):881-93. DOI: 10.1016/j.ijnurstu.2010.12.005. View