Examining Assumptions Regarding Valid Electronic Monitoring of Medication Therapy: Development of a Validation Framework and Its Application on a European Sample of Kidney Transplant Patients

Overview

Journal BMC Med Res Methodol

Publisher Biomed Central

Specialties General Medicine
Health Services

Date 2008 Feb 21

PMID 18284675

Citations 40

Authors

Kris Denhaerynck

Petra Schafer-Keller

James Young

Jurg Steiger

Andreas Bock

Sabina de Geest

Affiliations

Soon will be listed here.

Abstract

Background: Electronic monitoring (EM) is used increasingly to measure medication non-adherence. Unbiased EM assessment requires fulfillment of assumptions. The purpose of this study was to determine assumptions needed for internal and external validity of EM measurement. To test internal validity, we examined if (1) EM equipment functioned correctly, (2) if all EM bottle openings corresponded to actual drug intake, and (3) if EM did not influence a patient's normal adherence behavior. To assess external validity, we examined if there were indications that using EM affected the sample representativeness.

Methods: We used data from the Supporting Medication Adherence in Renal Transplantation (SMART) study, which included 250 adult renal transplant patients whose adherence to immunosuppressive drugs was measured during 3 months with the Medication Event Monitoring System (MEMS). Internal validity was determined by assessing the prevalence of nonfunctioning EM systems, the prevalence of patient-reported discrepancies between cap openings and actual intakes (using contemporaneous notes and interview at the end of the study), and by exploring whether adherence was initially uncharacteristically high and decreased over time (an indication of a possible EM intervention effect). Sample representativeness was examined by screening for differences between participants and non-participants or drop outs on non-adherence.

Results: Our analysis revealed that some assumptions were not fulfilled: 1) one cap malfunctioned (0.4%), 2) self-reported mismatches between bottle openings and actual drug intake occurred in 62% of the patients (n = 155), and 3) adherence decreased over the first 5 weeks of the monitoring, indicating that EM had a waning intervention effect.

Conclusion: The validity assumptions presented in this article should be checked in future studies using EM as a measure of medication non-adherence.

Citing Articles

User Experience of Persons Using Ingestible Sensor-Enabled Pre-Exposure Prophylaxis to Prevent HIV Infection: Cross-Sectional Survey Study.

Browne S, Umlauf A, Moore D, Benson C, Vaida F JMIR Mhealth Uhealth. 2024; 12:e53596.

PMID: 38722201 PMC: 11085042. DOI: 10.2196/53596.

Electronic Smart Blister Packages to Monitor and Support Medication Adherence: A Usability Study.

Izzah Z, Zijp T, Aberg C, Touw D, van Boven J Patient Prefer Adherence. 2022; 16:2543-2558.

PMID: 36124125 PMC: 9482437. DOI: 10.2147/PPA.S374685.

Electronically monitored medication adherence in idiopathic pulmonary fibrosis: prevalence, predictors and outcomes.

Delameillieure A, Wuyts W, Pironet A, Dobbels F ERJ Open Res. 2022; 8(3).

PMID: 35923422 PMC: 9339768. DOI: 10.1183/23120541.00030-2022.

Randomized Controlled Trial of a Remote Coaching mHealth Adherence Intervention in Youth Living with HIV.

Amico K, Lindsey J, Hudgens M, Dallas R, Horvath K, Dunlap A AIDS Behav. 2022; 26(12):3897-3913.

PMID: 35670987 PMC: 9171094. DOI: 10.1007/s10461-022-03717-2.

Women's Reports of Barriers to and Facilitators of Oral Medication Adherence During Ovarian Stimulation: A Mixed Methods Pilot Study.

Mahoney D, Russell C J Reprod Infertil. 2021; 22(3):184-200.

PMID: 34900639 PMC: 8607872. DOI: 10.18502/jri.v22i3.6719.

References

De Geest S, Abraham I, Moons P, Vandeputte M, Van Cleemput J, Evers G . Late acute rejection and subclinical noncompliance with cyclosporine therapy in heart transplant recipients. J Heart Lung Transplant. 1998; 17(9):854-63. View

Yeung M, OConnor S, Parry D, COCHRANE G . Compliance with prescribed drug therapy in asthma. Respir Med. 1994; 88(1):31-5. DOI: 10.1016/0954-6111(94)90171-6. View

Weng F, Israni A, Joffe M, Hoy T, Gaughan C, Newman M . Race and electronically measured adherence to immunosuppressive medications after deceased donor renal transplantation. J Am Soc Nephrol. 2005; 16(6):1839-48. DOI: 10.1681/ASN.2004121059. View

Hastie T, Tibshirani R . Generalized additive models for medical research. Stat Methods Med Res. 1995; 4(3):187-96. DOI: 10.1177/096228029500400302. View

Wagner G . Does discontinuing the use of pill boxes to facilitate electronic monitoring impede adherence?. Int J STD AIDS. 2003; 14(1):64-5. DOI: 10.1258/095646203321043327. View

Denhaerynck K, Steiger J, Bock A, Schafer-Keller P, Kofer S, Thannberger N . Prevalence and risk factors of non-adherence with immunosuppressive medication in kidney transplant patients. Am J Transplant. 2006; 7(1):108-16. DOI: 10.1111/j.1600-6143.2006.01611.x. View

Elixhauser A, Eisen S, Romeis J, Homan S . The effects of monitoring and feedback on compliance. Med Care. 1990; 28(10):882-93. DOI: 10.1097/00005650-199010000-00003. View

Matsui D, Hermann C, Klein J, Berkovitch M, Olivieri N, Koren G . Critical comparison of novel and existing methods of compliance assessment during a clinical trial of an oral iron chelator. J Clin Pharmacol. 1994; 34(9):944-9. DOI: 10.1002/j.1552-4604.1994.tb04009.x. View

Fennie K, Bova C, Williams A . Adjusting and censoring electronic monitoring device data. Implications for study outcomes. J Acquir Immune Defic Syndr. 2006; 43 Suppl 1:S88-95. DOI: 10.1097/01.qai.0000248336.97814.2f. View

10.

Osterberg L, Blaschke T . Adherence to medication. N Engl J Med. 2005; 353(5):487-97. DOI: 10.1056/NEJMra050100. View

11.

Deschamps A, Van Wijngaerden E, Denhaerynck K, de Geest S, Vandamme A . Use of electronic monitoring induces a 40-day intervention effect in HIV patients. J Acquir Immune Defic Syndr. 2006; 43(2):247-8. DOI: 10.1097/01.qai.0000246034.86135.89. View

12.

Liu H, Golin C, Miller L, Hays R, Beck C, Sanandaji S . A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001; 134(10):968-77. DOI: 10.7326/0003-4819-134-10-200105150-00011. View

13.

Vrijens B, Goetghebeur E . Comparing compliance patterns between randomized treatments. Control Clin Trials. 1997; 18(3):187-203. DOI: 10.1016/s0197-2456(96)00235-8. View

14.

Bova C, Fennie K, Knafl G, Dieckhaus K, Watrous E, Williams A . Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005; 9(1):103-10. DOI: 10.1007/s10461-005-1685-0. View

15.

Deschamps A, Graeve V, Van Wijngaerden E, De Saar V, Vandamme A, Van Vaerenbergh K . Prevalence and correlates of nonadherence to antiretroviral therapy in a population of HIV patients using Medication Event Monitoring System. AIDS Patient Care STDS. 2005; 18(11):644-57. DOI: 10.1089/apc.2004.18.644. View

16.

Glass T, de Geest S, Weber R, Vernazza P, Rickenbach M, Furrer H . Correlates of self-reported nonadherence to antiretroviral therapy in HIV-infected patients: the Swiss HIV Cohort Study. J Acquir Immune Defic Syndr. 2006; 41(3):385-92. DOI: 10.1097/01.qai.0000186371.95301.52. View

17.

Vrijens B, Tousset E, Rode R, Bertz R, Mayer S, Urquhart J . Successful projection of the time course of drug concentration in plasma during a 1-year period from electronically compiled dosing-time data used as input to individually parameterized pharmacokinetic models. J Clin Pharmacol. 2005; 45(4):461-7. DOI: 10.1177/0091270004274433. View

18.

Bertholet N, Favrat B, Brunner H, Burnier M . Why Objective Monitoring of Compliance is Important in the Management of Hypertension. J Clin Hypertens (Greenwich). 2001; 2(4):258-262. View

19.

Reddel H, Toelle B, Marks G, Ware S, Jenkins C, Woolcock A . Analysis of adherence to peak flow monitoring when recording of data is electronic. BMJ. 2002; 324(7330):146-7. PMC: 64515. DOI: 10.1136/bmj.324.7330.146. View

20.

Wagner G, Ghosh-Dastidar B . Electronic monitoring: adherence assessment or intervention?. HIV Clin Trials. 2002; 3(1):45-51. DOI: 10.1310/XGXU-FUDK-A9QT-MPTF. View