A Method for the Minimization of Competition Bias in Signal Detection from Spontaneous Reporting Databases

Overview

Journal Drug Saf

Specialties Pharmacology
Toxicology

Date 2015 Dec 31

PMID 26715499

Citations 11

Authors

Mickael Arnaud

Francesco Salvo

Ismail Ahmed

Philip Robinson

Nicholas Moore

Bernard Begaud

Pascale Tubert-Bitter

Antoine Pariente

Affiliations

Soon will be listed here.

Abstract

Introduction: The two methods for minimizing competition bias in signal of disproportionate reporting (SDR) detection--masking factor (MF) and masking ratio (MR)--have focused on the strength of disproportionality for identifying competitors and have been tested using competitors at the drug level.

Objectives: The aim of this study was to develop a method that relies on identifying competitors by considering the proportion of reports of adverse events (AEs) that mention the drug class at an adequate level of drug grouping to increase sensitivity (Se) for SDR unmasking, and its comparison with MF and MR.

Methods: Reports in the French spontaneous reporting database between 2000 and 2005 were selected. Five AEs were considered: myocardial infarction, pancreatitis, aplastic anemia, convulsions, and gastrointestinal bleeding; related reports were retrieved using standardized Medical Dictionary for Regulatory Activities (MedDRA(®)) queries. Potential competitors of AEs were identified using the developed method, i.e. Competition Index (ComIn), as well as MF and MR. All three methods were tested according to Anatomical Therapeutic Chemical (ATC) classification levels 2-5. For each AE, SDR detection was performed, first in the complete database, and second after removing reports mentioning competitors; SDRs only detected after the removal were unmasked. All unmasked SDRs were validated using the Summary of Product Characteristics, and constituted the reference dataset used for computing the performance for SDR unmasking (area under the curve [AUC], Se).

Results: Performance of the ComIn was highest when considering competitors at ATC level 3 (AUC: 62 %; Se: 52 %); similar results were obtained with MF and MR.

Conclusion: The ComIn could greatly minimize the competition bias in SDR detection. Further study using a larger dataset is needed.

Citing Articles

Identifying new drugs associated with pulmonary arterial hypertension: A WHO pharmacovigilance database disproportionality analysis.

Hlavaty A, Roustit M, Montani D, Chaumais M, Guignabert C, Humbert M Br J Clin Pharmacol. 2022; 88(12):5227-5237.

PMID: 35679331 PMC: 9795981. DOI: 10.1111/bcp.15436.

Development of a Network-Based Signal Detection Tool: The COVID-19 Adversome in the FDA Adverse Event Reporting System.

Fusaroli M, Raschi E, Gatti M, De Ponti F, Poluzzi E Front Pharmacol. 2021; 12:740707.

PMID: 34955821 PMC: 8694570. DOI: 10.3389/fphar.2021.740707.

New adaptive lasso approaches for variable selection in automated pharmacovigilance signal detection.

Courtois E, Tubert-Bitter P, Ahmed I BMC Med Res Methodol. 2021; 21(1):271.

PMID: 34852782 PMC: 8638444. DOI: 10.1186/s12874-021-01450-3.

Thromboembolic Events with Cyclin-Dependent Kinase 4/6 Inhibitors in the FDA Adverse Event Reporting System.

Raschi E, Fusaroli M, Ardizzoni A, Poluzzi E, De Ponti F Cancers (Basel). 2021; 13(8).

PMID: 33917020 PMC: 8067683. DOI: 10.3390/cancers13081758.

SGLT-2 inhibitors and atrial fibrillation in the Food and Drug Administration adverse event reporting system.

Bonora B, Raschi E, Avogaro A, Fadini G Cardiovasc Diabetol. 2021; 20(1):39.

PMID: 33573667 PMC: 7879696. DOI: 10.1186/s12933-021-01243-4.

References

Moore N, Kreft-Jais C, Haramburu F, Noblet C, Andrejak M, Ollagnier M . Reports of hypoglycaemia associated with the use of ACE inhibitors and other drugs: a case/non-case study in the French pharmacovigilance system database. Br J Clin Pharmacol. 1998; 44(5):513-8. PMC: 2042872. DOI: 10.1046/j.1365-2125.1997.00615.x. View

Bate A, Lindquist M, Edwards I, Olsson S, Orre R, Lansner A . A Bayesian neural network method for adverse drug reaction signal generation. Eur J Clin Pharmacol. 1998; 54(4):315-21. DOI: 10.1007/s002280050466. View

Juhlin K, Ye X, Star K, Noren G . Outlier removal to uncover patterns in adverse drug reaction surveillance - a simple unmasking strategy. Pharmacoepidemiol Drug Saf. 2013; 22(10):1119-29. DOI: 10.1002/pds.3474. View

Ryan P, Schuemie M, Welebob E, Duke J, Valentine S, Hartzema A . Defining a reference set to support methodological research in drug safety. Drug Saf. 2013; 36 Suppl 1:S33-47. DOI: 10.1007/s40264-013-0097-8. View

Ahmed I, Thiessard F, Miremont-Salame G, Haramburu F, Kreft-Jais C, Begaud B . Early detection of pharmacovigilance signals with automated methods based on false discovery rates: a comparative study. Drug Saf. 2012; 35(6):495-506. DOI: 10.2165/11597180-000000000-00000. View

Pariente A, Gregoire F, Fourrier-Reglat A, Haramburu F, Moore N . Impact of safety alerts on measures of disproportionality in spontaneous reporting databases: the notoriety bias. Drug Saf. 2007; 30(10):891-8. DOI: 10.2165/00002018-200730100-00007. View

Moore N . The past, present and perhaps future of pharmacovigilance: homage to Folke Sjoqvist. Eur J Clin Pharmacol. 2013; 69 Suppl 1:33-41. DOI: 10.1007/s00228-013-1486-8. View

Maignen F, Hauben M, Hung E, Van Holle L, Dogne J . Assessing the extent and impact of the masking effect of disproportionality analyses on two spontaneous reporting systems databases. Pharmacoepidemiol Drug Saf. 2013; 23(2):195-207. DOI: 10.1002/pds.3529. View

Salvo F, Raschi E, Moretti U, Chiarolanza A, Fourrier-Reglat A, Moore N . Pharmacological prioritisation of signals of disproportionate reporting: proposal of an algorithm and pilot evaluation. Eur J Clin Pharmacol. 2014; 70(5):617-25. DOI: 10.1007/s00228-014-1657-2. View

10.

Gould A . Practical pharmacovigilance analysis strategies. Pharmacoepidemiol Drug Saf. 2003; 12(7):559-74. DOI: 10.1002/pds.771. View

11.

Hanley J, McNeil B . The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982; 143(1):29-36. DOI: 10.1148/radiology.143.1.7063747. View

12.

Evans S, Waller P, Davis S . Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2002; 10(6):483-6. DOI: 10.1002/pds.677. View

13.

Trifiro G, Pariente A, Coloma P, Kors J, Polimeni G, Miremont-Salame G . Data mining on electronic health record databases for signal detection in pharmacovigilance: which events to monitor?. Pharmacoepidemiol Drug Saf. 2009; 18(12):1176-84. DOI: 10.1002/pds.1836. View

14.

Pariente A, Avillach P, Salvo F, Thiessard F, Miremont-Salame G, Fourrier-Reglat A . Effect of competition bias in safety signal generation: analysis of a research database of spontaneous reports in France. Drug Saf. 2012; 35(10):855-64. DOI: 10.1007/BF03261981. View

15.

Cantor S, Kattan M . Determining the area under the ROC curve for a binary diagnostic test. Med Decis Making. 2000; 20(4):468-70. DOI: 10.1177/0272989X0002000410. View

16.

Hauben M, Madigan D, Gerrits C, Walsh L, van Puijenbroek E . The role of data mining in pharmacovigilance. Expert Opin Drug Saf. 2005; 4(5):929-48. DOI: 10.1517/14740338.4.5.929. View

17.

Geniaux H, Assaf D, Miremont-Salame G, Raspaud B, Gouverneur A, Robinson P . Performance of the standardised MedDRA® queries for case retrieval in the French spontaneous reporting database. Drug Saf. 2014; 37(7):537-42. DOI: 10.1007/s40264-014-0187-2. View

18.

Pariente A, Didailler M, Avillach P, Miremont-Salame G, Fourrier-Reglat A, Haramburu F . A potential competition bias in the detection of safety signals from spontaneous reporting databases. Pharmacoepidemiol Drug Saf. 2010; 19(11):1166-71. DOI: 10.1002/pds.2022. View

19.

van Puijenbroek E, Bate A, Leufkens H, Lindquist M, Orre R, Egberts A . A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol Drug Saf. 2002; 11(1):3-10. DOI: 10.1002/pds.668. View

20.

Maignen F, Hauben M, Hung E, Van Holle L, Dogne J . A conceptual approach to the masking effect of measures of disproportionality. Pharmacoepidemiol Drug Saf. 2013; 23(2):208-17. DOI: 10.1002/pds.3530. View