Comparative Outcome Studies of Clinical Decision Support Software: Limitations to the Practice of Evidence-based System Acquisition

Overview

Journal J Am Med Inform Assoc

Publisher Oxford University Press

Specialty Medical Informatics

Date 2015 Feb 11

PMID 25665704

Citations 1

Authors

Gaurav Jay Dhiman

Kyle T Amber

Kenneth W Goodman

Affiliations

Soon will be listed here.

Abstract

Clinical decision support systems (CDSSs) assist clinicians with patient diagnosis and treatment. However, inadequate attention has been paid to the process of selecting and buying systems. The diversity of CDSSs, coupled with research obstacles, marketplace limitations, and legal impediments, has thwarted comparative outcome studies and reduced the availability of reliable information and advice for purchasers. We review these limitations and recommend several comparative studies, which were conducted in phases; studies conducted in phases and focused on limited outcomes of safety, efficacy, and implementation in varied clinical settings. Additionally, we recommend the increased availability of guidance tools to assist purchasers with evidence-based purchases. Transparency is necessary in purchasers' reporting of system defects and vendors' disclosure of marketing conflicts of interest to support methodologically sound studies. Taken together, these measures can foster the evolution of evidence-based tools that, in turn, will enable and empower system purchasers to make wise choices and improve the care of patients.

Citing Articles

Human Factors Considerations in Transitions in Care Clinical Decision Support System Implementation Studies.

Kennedy E, Bowles K AMIA Annu Symp Proc. 2022; 2021:621-630.

PMID: 35308926 PMC: 8861703.

References

Del Beccaro M, Jeffries H, Eisenberg M, Harry E . Computerized provider order entry implementation: no association with increased mortality rates in an intensive care unit. Pediatrics. 2006; 118(1):290-5. DOI: 10.1542/peds.2006-0367. View

Kuperman G, Bobb A, Payne T, Avery A, Gandhi T, Burns G . Medication-related clinical decision support in computerized provider order entry systems: a review. J Am Med Inform Assoc. 2006; 14(1):29-40. PMC: 2215064. DOI: 10.1197/jamia.M2170. View

Kawamoto K, Houlihan C, Balas E, Lobach D . Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005; 330(7494):765. PMC: 555881. DOI: 10.1136/bmj.38398.500764.8F. View

Hunt D, Haynes R, Hanna S, Smith K . Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998; 280(15):1339-46. DOI: 10.1001/jama.280.15.1339. View

Kantor M, Wright A, Burton M, Fraser G, Krall M, Maviglia S . Comparison of Computer-based Clinical Decision Support Systems and Content for Diabetes Mellitus. Appl Clin Inform. 2013; 2(3):284-303. PMC: 3631936. DOI: 10.4338/ACI-2011-02-RA-0012. View

Wright A, Sittig D, Ash J, Feblowitz J, Meltzer S, McMullen C . Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc. 2011; 18(3):232-42. PMC: 3078666. DOI: 10.1136/amiajnl-2011-000113. View

Sittig D, Ash J, Zhang J, Osheroff J, Michael Shabot M . Lessons from "Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system". Pediatrics. 2006; 118(2):797-801. DOI: 10.1542/peds.2005-3132. View

Runciman W, Kluger M, Morris R, Paix A, Watterson L, Webb R . Crisis management during anaesthesia: the development of an anaesthetic crisis management manual. Qual Saf Health Care. 2005; 14(3):e1. PMC: 1744021. DOI: 10.1136/qshc.2002.004101. View

Sirajuddin A, Osheroff J, Sittig D, Chuo J, Velasco F, Collins D . Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag. 2009; 23(4):38-45. PMC: 3316472. View

10.

Dexter P, Perkins S, Maharry K, Jones K, McDonald C . Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA. 2004; 292(19):2366-71. DOI: 10.1001/jama.292.19.2366. View

11.

. Safely implementing health information and converging technologies. Sentinel Event Alert. 2008; (42):1-4. View

12.

Goodman K, Berner E, Dente M, Kaplan B, Koppel R, Rucker D . Challenges in ethics, safety, best practices, and oversight regarding HIT vendors, their customers, and patients: a report of an AMIA special task force. J Am Med Inform Assoc. 2010; 18(1):77-81. PMC: 3005880. DOI: 10.1136/jamia.2010.008946. View

13.

Roshanov P, Misra S, Gerstein H, Garg A, Sebaldt R, Mackay J . Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011; 6:92. PMC: 3170626. DOI: 10.1186/1748-5908-6-92. View

14.

Ramnarayan P, Kapoor R, Coren M, Nanduri V, Tomlinson A, Taylor P . Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score. J Am Med Inform Assoc. 2003; 10(6):563-72. PMC: 264434. DOI: 10.1197/jamia.M1338. View

15.

Kuperman G, Reichley R, Bailey T . Using commercial knowledge bases for clinical decision support: opportunities, hurdles, and recommendations. J Am Med Inform Assoc. 2006; 13(4):369-71. PMC: 1513681. DOI: 10.1197/jamia.M2055. View

16.

Berner E, Webster G, Shugerman A, Jackson J, Algina J, Baker A . Performance of four computer-based diagnostic systems. N Engl J Med. 1994; 330(25):1792-6. DOI: 10.1056/NEJM199406233302506. View

17.

Kesselheim A, Cresswell K, Phansalkar S, Bates D, Sheikh A . Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. Health Aff (Millwood). 2011; 30(12):2310-7. DOI: 10.1377/hlthaff.2010.1111. View

18.

Koppel R, Kreda D . Health care information technology vendors' "hold harmless" clause: implications for patients and clinicians. JAMA. 2009; 301(12):1276-8. DOI: 10.1001/jama.2009.398. View

19.

Magrabi F, Ong M, Runciman W, Coiera E . Patient safety problems associated with heathcare information technology: an analysis of adverse events reported to the US Food and Drug Administration. AMIA Annu Symp Proc. 2011; 2011:853-7. PMC: 3243129. View

20.

Ramnarayan P, Roberts G, Coren M, Nanduri V, Tomlinson A, Taylor P . Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006; 6:22. PMC: 1513379. DOI: 10.1186/1472-6947-6-22. View