Validity of Performance Indicators for Assessing Prescribing Quality: the Case of Asthma

Overview

Journal Eur J Clin Pharmacol

Specialty Pharmacology

Date 2003 Nov 19

PMID 14624323

Citations 10

Authors

Lisa G Pont

Petra Denig

Thys van der Molen

Willem Jan van der Veen

Flora M Haaijer-Ruskamp

Affiliations

Soon will be listed here.

Abstract

Objectives: The aim of this study was to assess the concurrent validity between the identification of sub-optimal treatment based on clinical information and computer generated indicators. Indicators that are associated with sub-optimal treatment in one of the four steps of asthma management were assessed.

Design: The ability of each indicator to identify patients with sub-optimal asthma treatment from computerised general practitioner (GP) prescription records was assessed by comparing them with the results of an individual patient assessment using clinical data.

Setting: Chronic asthma patients ( n=146) registered with 16 Dutch GPs.

Main Measures: The sensitivity and positive predictive value (PPV) of each performance indicator was determined.

Results: The step-1 indicator, focusing on patients not prescribed a short-acting beta-agonist, had an acceptable sensitivity (0.86), but a low PPV (0.52). The two step-2 indicators, targeting under-prescription of inhaled corticosteroids, had sensitivities of 0.74 and 0.37 and PPVs of 0.46 and 0.71, respectively. The step-3 indicator, which targeted under-dosing of inhaled corticosteroids, had a sensitivity of 0.07 and a PPV of 0.2. The fourth indicator, focusing on under-prescription of long-acting beta-agonists, could not be validated due to inadequate numbers of patients with severe asthma in our study sample.

Discussion: None of the indicators investigated was considered valid for assessing prescriber performance, despite having good face and content validity. Performance indicators that have not been validated can only provide a broad-brush approach for assessing prescribing quality and should be used with extreme caution.

Citing Articles

Quality appraisal of antibiotic consumption in the community, European Union/European Economic Area, 2009 and 2017.

Adriaenssens N, Bruyndonckx R, Versporten A, Hens N, Monnet D, Molenberghs G J Antimicrob Chemother. 2021; 76(12 Suppl 2):ii60-ii67.

PMID: 34312656 PMC: 8314110. DOI: 10.1093/jac/dkab178.

The PIPc Study-application of indicators of potentially inappropriate prescribing in children (PIPc) to a national prescribing database in Ireland: a cross-sectional prevalence study.

Barry E, Moriarty F, Boland F, Bennett K, Smith S BMJ Open. 2018; 8(10):e022876.

PMID: 30344174 PMC: 6196813. DOI: 10.1136/bmjopen-2018-022876.

Identification of Dutch children diagnosed with atopic diseases using prescription data: a validation study.

Mulder B, Groenhof F, Kocabas L, Bos H, De Vries T, Hak E Eur J Clin Pharmacol. 2015; 72(1):73-82.

PMID: 26450360 PMC: 4701779. DOI: 10.1007/s00228-015-1940-x.

Developing a complex intervention to improve prescribing safety in primary care: mixed methods feasibility and optimisation pilot study.

Grant A, Guthrie B, Dreischulte T BMJ Open. 2014; 4(1):e004153.

PMID: 24448848 PMC: 3902335. DOI: 10.1136/bmjopen-2013-004153.

Compliance with quality prescribing indicators in terms of their relationship to financial incentives.

Fernandez Urrusuno R, Montero Balosa M, Perez Perez P, Pascual de la Pisa B Eur J Clin Pharmacol. 2013; 69(10):1845-53.

PMID: 23743780 DOI: 10.1007/s00228-013-1542-4.

References

Poloniecki J . Half of all doctors are below average. BMJ. 1998; 316(7146):1734-6. PMC: 1113280. DOI: 10.1136/bmj.316.7146.1734. View

Hallas J, Hansen N . Individual utilization of anti-asthma medication by young adults: a prescription database analysis. J Intern Med. 1993; 234(1):65-70. DOI: 10.1111/j.1365-2796.1993.tb00706.x. View

Lagerlov P, Loeb M, Andrew M, Hjortdahl P . Improving doctors' prescribing behaviour through reflection on guidelines and prescription feedback: a randomised controlled study. Qual Health Care. 2000; 9(3):159-65. PMC: 1743532. DOI: 10.1136/qhc.9.3.159. View

Wahlstrom R, Lagerlov P, Lundborg C, Veninga CCM , Hummers-Pradier E, Dahlgren L . Variations in general practitioners' views of asthma management in four European countries. Soc Sci Med. 2001; 53(4):507-18. DOI: 10.1016/s0277-9536(00)00356-7. View

West S, Savitz D, Koch G, Strom B, Guess H, Hartzema A . Recall accuracy for prescription medications: self-report compared with database information. Am J Epidemiol. 1995; 142(10):1103-12. DOI: 10.1093/oxfordjournals.aje.a117563. View

Brook R, McGlynn E, Shekelle P . Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000; 12(4):281-95. DOI: 10.1093/intqhc/12.4.281. View

Cantrill J, Sibbald B, Buetow S . Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability. Qual Health Care. 1998; 7(3):130-5. PMC: 2483608. DOI: 10.1136/qshc.7.3.130. View

Rabe K, Vermeire P, Soriano J, Maier W . Clinical management of asthma in 1999: the Asthma Insights and Reality in Europe (AIRE) study. Eur Respir J. 2001; 16(5):802-7. DOI: 10.1183/09031936.00.16580200. View

de Jong-van den Berg L, Waardenburg C, Haaijer-Ruskamp F, Dukes M, Wesseling H . Drug use in pregnancy: a comparative appraisal of data collecting methods. Eur J Clin Pharmacol. 1993; 45(1):9-14. DOI: 10.1007/BF00315343. View

10.

Shelley M, Croft P, Chapman S, Pantin C . Is the quality of asthma prescribing, as measured by the general practice ratio of corticosteroid to bronchodilator, associated with asthma morbidity?. J Clin Epidemiol. 2001; 53(12):1217-21. DOI: 10.1016/s0895-4356(00)00249-3. View

11.

Davis R . Measuring the performance of public health agencies. Government, like doctors and hospitals, should meet quality standards. BMJ. 1999; 318(7188):889-90. PMC: 1115320. DOI: 10.1136/bmj.318.7188.889. View

12.

Pringle M, Wilson T, Grol R . Measuring "goodness" in individuals and healthcare systems. BMJ. 2002; 325(7366):704-7. PMC: 1124227. DOI: 10.1136/bmj.325.7366.704. View

13.

Sheldon T . Promoting health care quality: what role performance indicators?. Qual Health Care. 1999; 7 Suppl:S45-50. View

14.

Spoeri R, Ullman R . Measuring and reporting managed care performance: lessons learned and new initiatives. Ann Intern Med. 1998; 127(8 Pt 2):726-32. DOI: 10.7326/0003-4819-127-8_part_2-199710151-00058. View

15.

Nadzam D . Development of medication-use indicators by the Joint Commission on Accreditation of Healthcare Organizations. Am J Hosp Pharm. 1991; 48(9):1925-30. View

16.

Aveyard P . Assessing the performance of general practices caring for patients with asthma. Br J Gen Pract. 1997; 47(420):423-6. PMC: 1313051. View

17.

. International Consensus Report on Diagnosis and Treatment of Asthma. Clin Exp Allergy. 1992; 22 Suppl 1:1-72. View

18.

van den Brandt P, Petri H, Dorant E, Goldbohm R, Van de Crommert S . Comparison of questionnaire information and pharmacy data on drug use. Pharm Weekbl Sci. 1991; 13(2):91-6. DOI: 10.1007/BF01974987. View

19.

Veninga C, Denig P, Pont L, Haaijer-Ruskamp F . Comparison of indicators assessing the quality of drug prescribing for asthma. Health Serv Res. 2001; 36(1 Pt 1):143-61. PMC: 1089220. View

20.

Veninga C, Denig P, Zwaagstra R, Haaijer-Ruskamp F . Improving drug treatment in general practice. J Clin Epidemiol. 2000; 53(7):762-72. DOI: 10.1016/s0895-4356(00)00194-3. View