A Risk Analysis Method to Evaluate the Impact of a Computerized Provider Order Entry System on Patient Safety

Objectives: Quantitative evaluation of safety after the implementation of a computerized provider order entry (CPOE) system, stratification of residual risks to drive future developments.

Design: Comparative risk analysis of the drug prescription process before and after the implementation of CPOE system, according to the Failure Modes, Effects and Criticality Analysis (FMECA) method.

Measurements: The failure modes were defined and their criticality indices calculated on the basis of the likelihood of occurrence, potential severity for patients, and detection probability. Criticality indices of handwritten and electronic prescriptions were compared, the acceptability of residual risks was discussed. Further developments were proposed and their potential impact on the safety was estimated.

Results: The sum of criticality indices of 27 identified failure modes was 3813 for the handwritten prescription, 2930 (-23%) for CPOE system, and 1658 (-57%) with 14 enhancements. The major safety improvements were observed for errors due to ambiguous, incomplete or illegible orders (-245 points), wrong dose determination (-217) and interactions (-196). Implementation of targeted pop-ups to remind treatment adaptation (-189), vital signs (-140), and automatic edition of documents needed for the dispensation (-126) were the most promising proposed improvements.

Conclusion: The impact of a CPOE system on patient safety strongly depends on the implemented functions and their ergonomics. The use of risk analysis helps to quantitatively evaluate the relationship between a system and patient safety and to build a strategy for continuous quality improvement, by selecting the most appropriate improvements to the system.