Development and Inter-rater Reliability of the Liverpool Adverse Drug Reaction Causality Assessment Tool

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2011 Dec 24

PMID 22194808

Citations 84

Authors

Ruairi M Gallagher

Jamie J Kirkham

Jennifer R Mason

Kim A Bird

Paula R Williamson

Anthony J Nunn

Mark A Turner

Rosalind L Smyth

Munir Pirmohamed

Affiliations

Soon will be listed here.

Abstract

Aim: To develop and test a new adverse drug reaction (ADR) causality assessment tool (CAT).

Methods: A comparison between seven assessors of a new CAT, formulated by an expert focus group, compared with the Naranjo CAT in 80 cases from a prospective observational study and 37 published ADR case reports (819 causality assessments in total).

Main Outcome Measures: Utilisation of causality categories, measure of disagreements, inter-rater reliability (IRR).

Results: The Liverpool ADR CAT, using 40 cases from an observational study, showed causality categories of 1 unlikely, 62 possible, 92 probable and 125 definite (1, 62, 92, 125) and 'moderate' IRR (kappa 0.48), compared to Naranjo (0, 100, 172, 8) with 'moderate' IRR (kappa 0.45). In a further 40 cases, the Liverpool tool (0, 66, 81, 133) showed 'good' IRR (kappa 0.6) while Naranjo (1, 90, 185, 4) remained 'moderate'.

Conclusion: The Liverpool tool assigns the full range of causality categories and shows good IRR. Further assessment by different investigators in different settings is needed to fully assess the utility of this tool.

Citing Articles

Adverse drug reactions and events in an Ageing PopulaTion risk Prediction (ADAPTiP) tool: the development and validation of a model for predicting adverse drug reactions and events in older patients.

Frydenlund J, Cosgrave N, Moriarty F, Wallace E, Kirke C, Williams D Eur Geriatr Med. 2025; .

PMID: 39821882 DOI: 10.1007/s41999-024-01152-1.

Update on Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis: Diagnosis and Management.

Shah H, Parisi R, Mukherjee E, Phillips E, Dodiuk-Gad R Am J Clin Dermatol. 2024; 25(6):891-908.

PMID: 39278968 PMC: 11511757. DOI: 10.1007/s40257-024-00889-6.

Exercise and brain health in patients with coronary artery disease: study protocol for the HEART-BRAIN randomized controlled trial.

Toval A, Solis-Urra P, Bakker E, Sanchez-Aranda L, Fernandez-Ortega J, Prieto C Front Aging Neurosci. 2024; 16:1437567.

PMID: 39246594 PMC: 11377337. DOI: 10.3389/fnagi.2024.1437567.

The Acute Kidney Intervention and Pharmacotherapy (AKIP) List: Standardized List of Medications That Are Renally Eliminated and Nephrotoxic in the Acutely Ill.

Barreto E, Gaggani A, Hernandez B, Amatullah N, Culley C, Stottlemyer B Ann Pharmacother. 2024; 59(4):371-377.

PMID: 39230007 PMC: 11871987. DOI: 10.1177/10600280241273191.

Morze K, Szalek E, Waszyk-Nowaczyk M Front Pharmacol. 2024; 15:1440681.

PMID: 39108757 PMC: 11300373. DOI: 10.3389/fphar.2024.1440681.

References

Turner W . The Food and Drug Administration algorithm. Special workshop--regulatory. Drug Inf J. 1983; 18(3-4):259-66. DOI: 10.1177/009286158401800311. View

IREY N . Teaching monograph. Tissue reactions to drugs. Am J Pathol. 1976; 82(3):613-47. PMC: 2032418. View

Laine L, Goldkind L, Curtis S, Connors L, Yanqiong Z, Cannon C . How common is diclofenac-associated liver injury? Analysis of 17,289 arthritis patients in a long-term prospective clinical trial. Am J Gastroenterol. 2009; 104(2):356-62. DOI: 10.1038/ajg.2008.149. View

Lantz C, Nebenzahl E . Behavior and interpretation of the kappa statistic: resolution of the two paradoxes. J Clin Epidemiol. 1996; 49(4):431-4. DOI: 10.1016/0895-4356(95)00571-4. View

Clavenna A, Bonati M . Adverse drug reactions in childhood: a review of prospective studies and safety alerts. Arch Dis Child. 2009; 94(9):724-8. DOI: 10.1136/adc.2008.154377. View

Agbabiaka T, Savovic J, Ernst E . Methods for causality assessment of adverse drug reactions: a systematic review. Drug Saf. 2007; 31(1):21-37. DOI: 10.2165/00002018-200831010-00003. View

Pirmohamed M, James S, Meakin S, Green C, Scott A, Walley T . Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients. BMJ. 2004; 329(7456):15-9. PMC: 443443. DOI: 10.1136/bmj.329.7456.15. View

Koh Y, Li S . A new algorithm to identify the causality of adverse drug reactions. Drug Saf. 2005; 28(12):1159-61. DOI: 10.2165/00002018-200528120-00010. View

Garcia-Cortes M, Lucena M, Pachkoria K, Borraz Y, Hidalgo R, Andrade R . Evaluation of naranjo adverse drug reactions probability scale in causality assessment of drug-induced liver injury. Aliment Pharmacol Ther. 2008; 27(9):780-9. DOI: 10.1111/j.1365-2036.2008.03655.x. View

10.

Kane-Gill S, Kirisci L, Pathak D . Are the Naranjo criteria reliable and valid for determination of adverse drug reactions in the intensive care unit?. Ann Pharmacother. 2005; 39(11):1823-7. DOI: 10.1345/aph.1G177. View

11.

Feinstein A, Cicchetti D . High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990; 43(6):543-9. DOI: 10.1016/0895-4356(90)90158-l. View

12.

Cicchetti D, Feinstein A . High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990; 43(6):551-8. DOI: 10.1016/0895-4356(90)90159-m. View

13.

Naranjo C, Busto U, Sellers E, Sandor P, Ruiz I, Roberts E . A method for estimating the probability of adverse drug reactions. Clin Pharmacol Ther. 1981; 30(2):239-45. DOI: 10.1038/clpt.1981.154. View

14.

Danan G, Benichou C . Causality assessment of adverse reactions to drugs--I. A novel method based on the conclusions of international consensus meetings: application to drug-induced liver injuries. J Clin Epidemiol. 1993; 46(11):1323-30. DOI: 10.1016/0895-4356(93)90101-6. View

15.

Macedo A, Marques F, Fontes Ribeiro C, Teixeira F . Causality assessment of adverse drug reactions: comparison of the results obtained from published decisional algorithms and from the evaluations of an expert panel. Pharmacoepidemiol Drug Saf. 2005; 14(12):885-90. DOI: 10.1002/pds.1138. View

16.

Hill A . THE ENVIRONMENT AND DISEASE: ASSOCIATION OR CAUSATION?. Proc R Soc Med. 1965; 58:295-300. PMC: 1898525. DOI: 10.1177/003591576505800503. View

17.

Arimone Y, Begaud B, Miremont-Salame G, Fourrier-Reglat A, Moore N, Molimard M . Agreement of expert judgment in causality assessment of adverse drug reactions. Eur J Clin Pharmacol. 2005; 61(3):169-73. DOI: 10.1007/s00228-004-0869-2. View

18.

Davies E, Green C, Taylor S, Williamson P, Mottram D, Pirmohamed M . Adverse drug reactions in hospital in-patients: a prospective analysis of 3695 patient-episodes. PLoS One. 2009; 4(2):e4439. PMC: 2635959. DOI: 10.1371/journal.pone.0004439. View

19.

Kling A, Mjorndal T, Rantapaa-Dahlqvist S . Sepsis as a possible adverse drug reaction in patients with rheumatoid arthritis treated with TNFalpha antagonists. J Clin Rheumatol. 2006; 10(3):119-22. DOI: 10.1097/01.rhu.0000128734.07926.8e. View

20.

Avner M, Finkelstein Y, Hackam D, Koren G . Establishing causality in pediatric adverse drug reactions: use of the Naranjo probability scale. Paediatr Drugs. 2007; 9(4):267-70. DOI: 10.2165/00148581-200709040-00007. View