Development and Validation of a Workflow Instrument to Evaluate the Success of Electronic Health Records Implementation from a Nursing Perspective: An Exploratory and Descriptive Study

Overview

Journal Glob J Qual Saf Healthc

Date 2025 Feb 12

PMID 39935718

Authors

Mohammad J Jaber

Ahmad M Al-Bashaireh

Osama Kouri

Mohannad A Aldiqs

Ola M Alqudah

Omar M Khraisat

Alanoud A Bindahmsh

Abeer M Alshodukhi

Amer O Almutairi

Nevin A Hakeem

Affiliations

Soon will be listed here.

Abstract

Introduction: Electronic medical records (EMR) have been recognized as practical tools for the improvement of the quality and safety of healthcare despite their occasional use in hospitals worldwide. Epic is an integrated software suite with functionality ranging from patient administration through systems for healthcare providers to billing systems, integration to the primary health sector, and a facility for granting patients access to their data. The implementation process is complicated; creating effective methods requires understanding users' attitudes about these information technologies. This study aimed to develop and validate a questionnaire that measures the efficacy of using workflow during the EMR (Epic) implementation. Furthermore, it describes the nurses' views on the use of quality and satisfaction of workflow.

Methods: Following a literature review, an initial pool of 57 items was generated based on the following three primary constructs: use, quality, and user satisfaction with the tool's workflow. Internal consistency reliability was assessed by calculating Cronbach's alpha and correlation coefficients for construct validity.

Results: The final scale comprised 53 items corresponding to the following five distinct factors: use of workflow, information quality, service quality, use of EMR, and user satisfaction and the influence of workflow on clinical care. The full scale was assessed, and Cronbach's alpha of 0.95 was found. The construct validity was assessed using the Kaiser-Meyer-Olkin measure of sampling adequacy and Bartlett's Test of Sphericity (0.976). Construct validity was tested twice using Exploratory Factor Analysis-Principal Component Analysis.

Conclusion: The use of workflow, quality of information, quality of service, use of EMR, and user satisfaction scale have good reliability and validity and can be used to implement technology in healthcare.

References

Vaughn V, Linder J . Thoughtless design of the electronic health record drives overuse, but purposeful design can nudge improved patient care. BMJ Qual Saf. 2018; 27(8):583-586. DOI: 10.1136/bmjqs-2017-007578. View

Hertzum M, Ellingsen G . The implementation of an electronic health record: Comparing preparations for Epic in Norway with experiences from the UK and Denmark. Int J Med Inform. 2019; 129:312-317. DOI: 10.1016/j.ijmedinf.2019.06.026. View

Sayyah Gilani M, Iranmanesh M, Nikbin D, Zailani S . EMR continuance usage intention of healthcare professionals. Inform Health Soc Care. 2016; 42(2):153-165. DOI: 10.3109/17538157.2016.1160245. View

Westbrook J, Li L, Hooper T, Raban M, Middleton S, Lehnbom E . Effectiveness of a 'Do not interrupt' bundled intervention to reduce interruptions during medication administration: a cluster randomised controlled feasibility study. BMJ Qual Saf. 2017; 26(9):734-742. PMC: 5574391. DOI: 10.1136/bmjqs-2016-006123. View

Alshammary S, Abuzied Y, Ratnapalan S . Enhancing palliative care occupancy and efficiency: a quality improvement project that uses a healthcare pathway for service integration and policy development. BMJ Open Qual. 2021; 10(4). PMC: 8552138. DOI: 10.1136/bmjoq-2021-001391. View

Mishuris R, Palmisano J, McCullagh L, Hess R, Feldstein D, Smith P . Using normalisation process theory to understand workflow implications of decision support implementation across diverse primary care settings. BMJ Health Care Inform. 2019; 26(1). PMC: 7062348. DOI: 10.1136/bmjhci-2019-100088. View

Han Y, Carcillo J, Venkataraman S, Clark R, Watson R, Nguyen T . Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005; 116(6):1506-12. DOI: 10.1542/peds.2005-1287. View

Chen A, Baxter S, Gali H, Long C, Ozzello D, Liu C . Evaluation of Electronic Health Record Implementation in an Academic Oculoplastics Practice. Ophthalmic Plast Reconstr Surg. 2019; 36(3):277-283. PMC: 7210068. DOI: 10.1097/IOP.0000000000001531. View

Farokhzadian J, Khajouei R, Hasman A, Ahmadian L . Nurses' experiences and viewpoints about the benefits of adopting information technology in health care: a qualitative study in Iran. BMC Med Inform Decis Mak. 2020; 20(1):240. PMC: 7507818. DOI: 10.1186/s12911-020-01260-5. View

10.

Ash J, Sittig D, Poon E, Guappone K, Campbell E, Dykstra R . The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2007; 14(4):415-23. PMC: 2244906. DOI: 10.1197/jamia.M2373. View

11.

Buntin M, Burke M, Hoaglin M, Blumenthal D . The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood). 2011; 30(3):464-71. DOI: 10.1377/hlthaff.2011.0178. View

12.

Guite J, Lang M, McCartan P, Miller J . Nursing admissions process redesigned to leverage EHR. J Healthc Inf Manag. 2006; 20(2):55-64. View

13.

Laxmisan A, Hakimzada F, Sayan O, Green R, Zhang J, Patel V . The multitasking clinician: decision-making and cognitive demand during and after team handoffs in emergency care. Int J Med Inform. 2006; 76(11-12):801-11. DOI: 10.1016/j.ijmedinf.2006.09.019. View

14.

Bolarinwa O . Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J. 2016; 22(4):195-201. DOI: 10.4103/1117-1936.173959. View

15.

Ratwani R, Fairbanks T, Savage E, Adams K, Wittie M, Boone E . Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation. Appl Clin Inform. 2016; 7(4):1069-1087. PMC: 5228144. DOI: 10.4338/ACI-2016-06-R-0105. View

16.

Jedwab R, Hutchinson A, Manias E, Calvo R, Dobroff N, Glozier N . Nurse Motivation, Engagement and Well-Being before an Electronic Medical Record System Implementation: A Mixed Methods Study. Int J Environ Res Public Health. 2021; 18(5). PMC: 7967448. DOI: 10.3390/ijerph18052726. View

17.

Fontaine B, Speedie S, ABELSON D, Wold C . A work-sampling tool to measure the effect of electronic medical record implementation on health care workers. J Ambul Care Manage. 2001; 23(1):71-85. DOI: 10.1097/00004479-200001000-00007. View

18.

Abuzied Y . A Practical Guide to the Kaizen Approach as a Quality Improvement Tool. Glob J Qual Saf Healthc. 2023; 5(3):79-81. PMC: 10229000. DOI: 10.36401/JQSH-22-11. View

19.

Fennelly O, Cunningham C, Grogan L, Cronin H, OShea C, Roche M . Successfully implementing a national electronic health record: a rapid umbrella review. Int J Med Inform. 2020; 144:104281. PMC: 7510429. DOI: 10.1016/j.ijmedinf.2020.104281. View

20.

Unertl K, Novak L, Johnson K, Lorenzi N . Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review. J Am Med Inform Assoc. 2010; 17(3):265-73. PMC: 2995718. DOI: 10.1136/jamia.2010.004333. View