Systematic Review and Narrative Synthesis of Computerized Audit and Feedback Systems in Healthcare

Overview

Journal J Am Med Inform Assoc

Publisher Oxford University Press

Specialty Medical Informatics

Date 2022 Mar 10

PMID 35271724

Authors

Jung Yin Tsang

Niels Peek

Iain Buchan

Sabine N van der Veer

Benjamin Brown

Affiliations

Soon will be listed here.

Abstract

Objectives: (1) Systematically review the literature on computerized audit and feedback (e-A&F) systems in healthcare. (2) Compare features of current systems against e-A&F best practices. (3) Generate hypotheses on how e-A&F systems may impact patient care and outcomes.

Methods: We searched MEDLINE (Ovid), EMBASE (Ovid), and CINAHL (Ebsco) databases to December 31, 2020. Two reviewers independently performed selection, extraction, and quality appraisal (Mixed Methods Appraisal Tool). System features were compared with 18 best practices derived from Clinical Performance Feedback Intervention Theory. We then used realist concepts to generate hypotheses on mechanisms of e-A&F impact. Results are reported in accordance with the PRISMA statement.

Results: Our search yielded 4301 unique articles. We included 88 studies evaluating 65 e-A&F systems, spanning a diverse range of clinical areas, including medical, surgical, general practice, etc. Systems adopted a median of 8 best practices (interquartile range 6-10), with 32 systems providing near real-time feedback data and 20 systems incorporating action planning. High-confidence hypotheses suggested that favorable e-A&F systems prompted specific actions, particularly enabled by timely and role-specific feedback (including patient lists and individual performance data) and embedded action plans, in order to improve system usage, care quality, and patient outcomes.

Conclusions: e-A&F systems continue to be developed for many clinical applications. Yet, several systems still lack basic features recommended by best practice, such as timely feedback and action planning. Systems should focus on actionability, by providing real-time data for feedback that is specific to user roles, with embedded action plans.

Protocol Registration: PROSPERO CRD42016048695.

Citing Articles

Deploying an asthma dashboard to support quality improvement across a nationally representative sentinel network of 7.6 million people in England.

Mukherjee M, Okusi C, Jamie G, Byford R, Ferreira F, Fletcher M NPJ Prim Care Respir Med. 2024; 34(1):18.

PMID: 38951547 PMC: 11217285. DOI: 10.1038/s41533-024-00377-8.

Therapeutic inertia.

Usherwood T Aust Prescr. 2024; 47(1):15-19.

PMID: 38444892 PMC: 10911837. DOI: 10.18773/austprescr.2024.001.

Digital dashboards for direct oral anticoagulant surveillance, intervention and operational efficiency: uptake, obstacles, and opportunities.

Triller D, Wilson A, Allen A, Burnett A, Gouveia-Pisano J, Brenner A J Thromb Thrombolysis. 2023; 57(1):107-116.

PMID: 37839023 PMC: 10830621. DOI: 10.1007/s11239-023-02893-9.

Digital dashboards for oral anticoagulation management: a literature scoping review.

Wilson A, Triller D, Allen A, Burnett A, Gouveia-Pisano J, Brenner A J Thromb Thrombolysis. 2023; 56(4):568-577.

PMID: 37596426 PMC: 10550856. DOI: 10.1007/s11239-023-02880-0.

Cognitive perspectives on maintaining physicians' medical expertise: I. Reimagining Maintenance of Certification to promote lifelong learning.

Rottman B, Caddick Z, Nokes-Malach T, Fraundorf S Cogn Res Princ Implic. 2023; 8(1):46.

PMID: 37486508 PMC: 10366070. DOI: 10.1186/s41235-023-00496-9.

References

Dixon-Woods M, Redwood S, Leslie M, Minion J, Martin G, Coleman J . Improving quality and safety of care using "technovigilance": an ethnographic case study of secondary use of data from an electronic prescribing and decision support system. Milbank Q. 2013; 91(3):424-54. PMC: 3790520. DOI: 10.1111/1468-0009.12021. View

Gude W, van Engen-Verheul M, van der Veer S, Kemps H, Jaspers M, de Keizer N . Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation. Implement Sci. 2016; 11(1):160. PMC: 5148845. DOI: 10.1186/s13012-016-0516-1. View

Boggan J, Swaminathan A, Thomas S, Simel D, Zaas A, Bae J . Improving Timely Resident Follow-Up and Communication of Results in Ambulatory Clinics Utilizing a Web-Based Audit and Feedback Module. J Grad Med Educ. 2017; 9(2):195-200. PMC: 5398151. DOI: 10.4300/JGME-D-16-00460.1. View

Trinh L, Roach E, Vogan E, Lam S, Eggers G . Impact of a quality-assessment dashboard on the comprehensive review of pharmacist performance. Am J Health Syst Pharm. 2017; 74(17 Supplement 3):S75-S83. DOI: 10.2146/ajhp160556. View

Kurtzman G, Dine J, Epstein A, Gitelman Y, Leri D, Patel M . Internal Medicine Resident Engagement with a Laboratory Utilization Dashboard: Mixed Methods Study. J Hosp Med. 2017; 12(9):743-746. PMC: 5803096. DOI: 10.12788/jhm.2811. View

Sheen Y, Huang C, Huang S, Lin C, Lee I, Sheu W . Electronic dashboard-based remote glycemic management program reduces length of stay and readmission rate among hospitalized adults. J Diabetes Investig. 2021; 12(9):1697-1707. PMC: 8409866. DOI: 10.1111/jdi.13500. View

Lin L, Bohnert A, Kerns R, Clay M, Ganoczy D, Ilgen M . Impact of the Opioid Safety Initiative on opioid-related prescribing in veterans. Pain. 2017; 158(5):833-839. DOI: 10.1097/j.pain.0000000000000837. View

Weiss D, Dunn S, Sprague A, Fell D, Grimshaw J, Darling E . Effect of a population-level performance dashboard intervention on maternal-newborn outcomes: an interrupted time series study. BMJ Qual Saf. 2017; 27(6):425-436. PMC: 5965347. DOI: 10.1136/bmjqs-2017-007361. View

Harris S, Morgan M, Davies E . Web-based reporting of the results of the 2006 four country prevalence survey of healthcare associated infections. J Hosp Infect. 2008; 69(3):258-64. DOI: 10.1016/j.jhin.2008.04.005. View

10.

Gude W, van der Veer S, van Engen-Verheul M, de Keizer N, Peek N . Inside the Black Box of Audit and Feedback: a Laboratory Study to Explore Determinants of Improvement Target Selection by Healthcare Professionals in Cardiac Rehabilitation. Stud Health Technol Inform. 2015; 216:424-8. View

11.

Geller B, Ichikawa L, Miglioretti D, Eastman D . Web-based mammography audit feedback. AJR Am J Roentgenol. 2012; 198(6):W562-7. PMC: 3618689. DOI: 10.2214/AJR.11.7971. View

12.

Parsons A, McCullough C, Wang J, Shih S . Validity of electronic health record-derived quality measurement for performance monitoring. J Am Med Inform Assoc. 2012; 19(4):604-9. PMC: 3384112. DOI: 10.1136/amiajnl-2011-000557. View

13.

Wu D, Chen A, Manning J, Levy-Fix G, Backonja U, Borland D . Evaluating visual analytics for health informatics applications: a systematic review from the American Medical Informatics Association Visual Analytics Working Group Task Force on Evaluation. J Am Med Inform Assoc. 2019; 26(4):314-323. PMC: 7647177. DOI: 10.1093/jamia/ocy190. View

14.

Bravata D, Myers L, Perkins A, Zhang Y, Miech E, Rattray N . Assessment of the Protocol-Guided Rapid Evaluation of Veterans Experiencing New Transient Neurological Symptoms (PREVENT) Program for Improving Quality of Care for Transient Ischemic Attack: A Nonrandomized Cluster Trial. JAMA Netw Open. 2020; 3(9):e2015920. PMC: 7489850. DOI: 10.1001/jamanetworkopen.2020.15920. View

15.

Lo Y, Lee W, Chen G, Liu C . Improving the work efficiency of healthcare-associated infection surveillance using electronic medical records. Comput Methods Programs Biomed. 2014; 117(2):351-9. DOI: 10.1016/j.cmpb.2014.07.006. View

16.

Thomas K, Thomas M, Stroebel R, McDonald F, Hanson G, Naessens J . Use of a registry-generated audit, feedback, and patient reminder intervention in an internal medicine resident clinic--a randomized trial. J Gen Intern Med. 2007; 22(12):1740-4. PMC: 2219846. DOI: 10.1007/s11606-007-0431-x. View

17.

Waitman L, Phillips I, McCoy A, Danciu I, Halpenny R, Nelsen C . Adopting real-time surveillance dashboards as a component of an enterprisewide medication safety strategy. Jt Comm J Qual Patient Saf. 2011; 37(7):326-32. DOI: 10.1016/s1553-7250(11)37041-9. View

18.

Carney P, Abraham L, Cook A, Feig S, Sickles E, Miglioretti D . Impact of an educational intervention designed to reduce unnecessary recall during screening mammography. Acad Radiol. 2012; 19(9):1114-20. PMC: 3638784. DOI: 10.1016/j.acra.2012.05.003. View

19.

Hartzler A, Chaudhuri S, Fey B, Flum D, Lavallee D . Integrating Patient-Reported Outcomes into Spine Surgical Care through Visual Dashboards: Lessons Learned from Human-Centered Design. EGEMS (Wash DC). 2015; 3(2):1133. PMC: 4431498. DOI: 10.13063/2327-9214.1133. View

20.

Filardo G, Nicewander D, Herrin J, Galimbertti P, Tietze M, McBride S . Challenges in conducting a hospital-randomized trial of an educational quality improvement intervention in rural and small community hospitals. Am J Med Qual. 2008; 23(6):440-7. DOI: 10.1177/1062860608324546. View