Conceptualising Contexts, Mechanisms and Outcomes for Implementing Large-scale, Multisite Hospital Improvement Initiatives: a Realist Synthesis

Overview

Journal BMJ Open

Specialty General Medicine

Date 2022 May 19

PMID 35589340

Authors

Janet C Long

Mitchell N Sarkies

Emilie Francis Auton

Hoa Mi Nguyen

Chiara Pomare

Rebecca Hardwick

Jeffrey Braithwaite

Affiliations

Soon will be listed here.

Abstract

Design: Realist synthesis.

Study Background: Large-scale hospital improvement initiatives can standardise healthcare across multiple sites but results are contingent on the implementation strategies that complement them. The benefits of these implemented interventions are rarely able to be replicated in different contexts. Realist studies explore this phenomenon in depth by identifying underlying context-mechanism-outcome interactions.

Objectives: To review implementation strategies used in large-scale hospital initiatives and hypothesise initial programme theories for how they worked across different contexts.

Methods: An iterative, four-step process was applied. Step 1 explored the concepts inherent in large-scale interventions using database searches and snowballing. Step 2 identified strategies used in their implementation. Step 3 identified potential initial programme theories that may explain strategies' mechanisms. Step 4 focused on one strategy-theory pairing to develop and test context-mechanism-outcome hypotheses. Data was drawn from searches (March-May 2020) of MEDLINE, Embase, PubMed and CINAHL, snowballed from key papers, implementation support websites and the expertise of the research team and experts.

Inclusion Criteria: reported implementation of a large-scale, multisite hospital intervention. RAMESES reporting standards were followed.

Results: Concepts were identified from 51 of 381 articles. Large-scale hospital interventions were characterised by a top-down approach, external and internal support and use of evidence-based interventions. We found 302 reports of 28 different implementation strategies from 31 reviews (from a total of 585). Formal theories proposed for the implementation strategies included Diffusion of Innovation, and Organisational Readiness Theory. Twenty-three context-mechanism-outcome statements for implementation strategies associated with planning and assessment activities were proposed. Evidence from the published literature supported the hypothesised programme theories and were consistent with Organisational Readiness Theory's tenets.

Conclusion: This paper adds to the literature exploring why large-scale hospital interventions are not always successfully implemented and suggests 24 causative mechanisms and contextual factors that may drive outcomes in the planning and assessment stage.

Citing Articles

Implementation of large, multi-site hospital interventions: a realist evaluation of strategies for developing capability.

Long J, Roberts N, Francis-Auton E, Sarkies M, Nguyen H, Westbrook J BMC Health Serv Res. 2024; 24(1):303.

PMID: 38448960 PMC: 10918928. DOI: 10.1186/s12913-024-10721-w.

Four System Enablers of Large-System Transformation in Health Care: A Mixed Methods Realist Evaluation.

Francis-Auton E, Long J, Sarkies M, Roberts N, Westbrook J, Levesque J Milbank Q. 2023; 102(1):183-211.

PMID: 38145375 PMC: 10938932. DOI: 10.1111/1468-0009.12684.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms.

Sarkies M, Francis-Auton E, Long J, Roberts N, Westbrook J, Levesque J Implement Sci. 2023; 18(1):71.

PMID: 38082301 PMC: 10714549. DOI: 10.1186/s13012-023-01324-w.

Guiding principles for effective collaborative implementation strategies for multisite hospital improvement initiatives: a mixed-method realist evaluation of collaborative strategies used in four multisite initiatives at public hospitals in New....

Long J, Sarkies M, Francis-Auton E, Roberts N, Hardwick R, Nguyen H BMJ Open. 2023; 13(6):e070799.

PMID: 37286318 PMC: 10254988. DOI: 10.1136/bmjopen-2022-070799.

Turning evidence into action using a senior friendly hospital framework and a collaborative network.

Ryan D, Zeh W, Tsang A, Schwartz R, Wong K, Straus S Healthc Manage Forum. 2022; 35(6):363-369.

PMID: 36154320 PMC: 9615338. DOI: 10.1177/08404704221121800.

References

Haynes A, Weiser T, Berry W, Lipsitz S, Breizat A, Dellinger E . A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009; 360(5):491-9. DOI: 10.1056/NEJMsa0810119. View

Morrow E, Robert G, Maben J, Griffiths P . Implementing large-scale quality improvement: lessons from The Productive Ward: Releasing Time to Care. Int J Health Care Qual Assur. 2012; 25(4):237-53. DOI: 10.1108/09526861211221464. View

Sarkies M, Francis-Auton E, Long J, Partington A, Pomare C, Nguyen H . Implementing large-system, value-based healthcare initiatives: a realist study protocol for seven natural experiments. BMJ Open. 2020; 10(12):e044049. PMC: 7757496. DOI: 10.1136/bmjopen-2020-044049. View

Proctor E, Powell B, McMillen J . Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013; 8:139. PMC: 3882890. DOI: 10.1186/1748-5908-8-139. View

Zapka J, Simpson K, Hiott L, Langston L, Fakhry S, Ford D . A mixed methods descriptive investigation of readiness to change in rural hospitals participating in a tele-critical care intervention. BMC Health Serv Res. 2013; 13:33. PMC: 3565938. DOI: 10.1186/1472-6963-13-33. View

Cunningham U, Ward M, De Brun A, McAuliffe E . Team interventions in acute hospital contexts: a systematic search of the literature using realist synthesis. BMC Health Serv Res. 2018; 18(1):536. PMC: 6042358. DOI: 10.1186/s12913-018-3331-3. View

Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove S . An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006; 355(26):2725-32. DOI: 10.1056/NEJMoa061115. View

Sarkies M, Long J, Pomare C, Wu W, Clay-Williams R, Nguyen H . Avoiding unnecessary hospitalisation for patients with chronic conditions: a systematic review of implementation determinants for hospital avoidance programmes. Implement Sci. 2020; 15(1):91. PMC: 7579904. DOI: 10.1186/s13012-020-01049-0. View

van Harten W, Goedbloed N, Boekhout A, Heintzbergen S . Implementing large scale fast track diagnostics in a comprehensive cancer center, pre- and post-measurement data. BMC Health Serv Res. 2018; 18(1):85. PMC: 5804070. DOI: 10.1186/s12913-018-2868-5. View

10.

Wand T, Crawford C, Bell N, Murphy M, White K, Wood E . Documenting the pre-implementation phase for a multi-site translational research project to test a new model Emergency Department-based mental health nursing care. Int Emerg Nurs. 2019; 45:10-16. DOI: 10.1016/j.ienj.2019.04.001. View

11.

Kislov R, Pope C, Martin G, Wilson P . Harnessing the power of theorising in implementation science. Implement Sci. 2019; 14(1):103. PMC: 6905028. DOI: 10.1186/s13012-019-0957-4. View

12.

Greenhalgh T, Humphrey C, Hughes J, Macfarlane F, Butler C, Pawson R . How do you modernize a health service? A realist evaluation of whole-scale transformation in london. Milbank Q. 2009; 87(2):391-416. PMC: 2881448. DOI: 10.1111/j.1468-0009.2009.00562.x. View

13.

Sharma N, Herrnschmidt J, Claes V, Bachnick S, de Geest S, Simon M . Organizational readiness for implementing change in acute care hospitals: An analysis of a cross-sectional, multicentre study. J Adv Nurs. 2018; 74(12):2798-2808. DOI: 10.1111/jan.13801. View

14.

Rees G . Organisational readiness and Lean Thinking implementation: findings from three emergency department case studies in New Zealand. Health Serv Manage Res. 2015; 27(1-2):1-9. DOI: 10.1177/0951484814532624. View

15.

Pronovost P . Interventions to decrease catheter-related bloodstream infections in the ICU: the Keystone Intensive Care Unit Project. Am J Infect Control. 2008; 36(10):S171.e1-5. DOI: 10.1016/j.ajic.2008.10.008. View

16.

Kourouche S, Buckley T, Van C, Munroe B, Curtis K . Designing strategies to implement a blunt chest injury care bundle using the behaviour change wheel: a multi-site mixed methods study. BMC Health Serv Res. 2019; 19(1):461. PMC: 6615309. DOI: 10.1186/s12913-019-4177-z. View

17.

Rapport F, Clay-Williams R, Churruca K, Shih P, Hogden A, Braithwaite J . The struggle of translating science into action: Foundational concepts of implementation science. J Eval Clin Pract. 2017; 24(1):117-126. PMC: 5901403. DOI: 10.1111/jep.12741. View

18.

Pawson R, Greenhalgh T, Harvey G, Walshe K . Realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005; 10 Suppl 1:21-34. DOI: 10.1258/1355819054308530. View

19.

Reames B, Krell R, Campbell Jr D, Dimick J . A checklist-based intervention to improve surgical outcomes in Michigan: evaluation of the Keystone Surgery program. JAMA Surg. 2015; 150(3):208-15. PMC: 4366309. DOI: 10.1001/jamasurg.2014.2873. View

20.

Hendy J, Fulop N, Reeves B, Hutchings A, Collin S . Implementing the NHS information technology programme: qualitative study of progress in acute trusts. BMJ. 2007; 334(7608):1360. PMC: 1906623. DOI: 10.1136/bmj.39195.598461.551. View