Compliance in Ambulatory Assessment Studies: Investigating Study and Sample Characteristics As Predictors

Overview

Journal Assessment

Publisher Sage Publications

Specialties Psychiatry
Psychology

Date 2021 Jul 20

PMID 34282659

Citations 15

Authors

Charlotte Ottenstein

Linda Werner

Affiliations

Soon will be listed here.

Abstract

Ambulatory assessment (AA) studies are becoming more and more popular. However, it can be challenging to motivate participants to comply with study protocols. The aim of the present study was to investigate possible predictors of compliance in AA studies with diverse samples and study designs. To do so, we extracted compliance information, study characteristics, and sample characteristics from 488 previously published studies. The average compliance across the studies was rather high. The total number of measurement occasions and the number of study days were negatively related to the compliance rate. Moreover, a higher percentage of healthy controls in clinical studies was associated with a higher compliance rate. By contrast, other study characteristics (e.g., the amount of financial compensation) and sample characteristics (clinical vs. healthy sample) were not related to compliance. The findings have implications for the design of future AA studies.

Citing Articles

Impact of Providing a Personalized Data Dashboard on Ecological Momentary Assessment Compliance Among College Students Who Use Substances: Pilot Microrandomized Trial.

Linden-Carmichael A, Stull S, Wang D, Bhandari S, Lanza S JMIR Form Res. 2024; 8:e60193.

PMID: 39637378 PMC: 11659699. DOI: 10.2196/60193.

Exploring emotions beyond the laboratory: A review of emotional and physiological ecological momentary assessment methods in children and youth.

Sosa-Hernandez L, Vogel N, Frankiewicz K, Reaume C, Drew A, McVey Neufeld S Psychophysiology. 2024; 61(12):e14699.

PMID: 39367539 PMC: 11579238. DOI: 10.1111/psyp.14699.

Effects of job demands, job resources, personal resources on night-shift alertness of ICU shift nurses: a cross‑sectional survey study based on the job demands-resources model.

Gou J, Zhang X, He Y, He K, Xu J BMC Nurs. 2024; 23(1):648.

PMID: 39267008 PMC: 11395936. DOI: 10.1186/s12912-024-02313-0.

Pubertal timing in adolescence and adulthood: Relations among contemporaneous and retrospective measures.

Chaku N, Berenbaum S, Qian Y, Corley R, Wadsworth S, Reynolds C Dev Psychol. 2024; .

PMID: 39250300 PMC: 11890207. DOI: 10.1037/dev0001784.

Acceptability and Feasibility of an Ecological Momentary Intervention for Managing Emotional Distress Among Psychiatric Inpatients at Risk for Suicide.

Kleiman E, Bentley K, Jaroszewski A, Maimone J, Fortgang R, Zuromski K Arch Suicide Res. 2024; :1-18.

PMID: 39185950 PMC: 11861377. DOI: 10.1080/13811118.2024.2391293.

References

Ramsey A, Wetherell J, Depp C, Dixon D, Lenze E . Feasibility and Acceptability of Smartphone Assessment in Older Adults with Cognitive and Emotional Difficulties. J Technol Hum Serv. 2016; 34(2):209-223. PMC: 5036573. DOI: 10.1080/15228835.2016.1170649. View

Courvoisier D, Eid M, Lischetzke T . Compliance to a cell phone-based ecological momentary assessment study: the effect of time and personality characteristics. Psychol Assess. 2012; 24(3):713-20. DOI: 10.1037/a0026733. View

Gershon A, Kaufmann C, Torous J, Depp C, Ketter T . Electronic Ecological Momentary Assessment (EMA) in youth with bipolar disorder: Demographic and clinical predictors of electronic EMA adherence. J Psychiatr Res. 2019; 116:14-18. DOI: 10.1016/j.jpsychires.2019.05.026. View

Comulada W, Lightfoot M, Swendeman D, Grella C, Wu N . Compliance to Cell Phone-Based EMA Among Latino Youth in Outpatient Treatment. J Ethn Subst Abuse. 2015; 14(3):232-50. PMC: 4550490. DOI: 10.1080/15332640.2014.986354. View

Wen C, Schneider S, Stone A, Spruijt-Metz D . Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis. J Med Internet Res. 2017; 19(4):e132. PMC: 5425774. DOI: 10.2196/jmir.6641. View

Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I . Compliance and Retention With the Experience Sampling Method Over the Continuum of Severe Mental Disorders: Meta-Analysis and Recommendations. J Med Internet Res. 2019; 21(12):e14475. PMC: 6925392. DOI: 10.2196/14475. View

Stone A, Shiffman S . Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med. 2002; 24(3):236-43. DOI: 10.1207/S15324796ABM2403_09. View

Button K, Ioannidis J, Mokrysz C, Nosek B, Flint J, Robinson E . Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013; 14(5):365-76. DOI: 10.1038/nrn3475. View

Diener E, Oishi S, Tay L . Advances in subjective well-being research. Nat Hum Behav. 2019; 2(4):253-260. DOI: 10.1038/s41562-018-0307-6. View

10.

Newcomb M, Swann G, Estabrook R, Corden M, Begale M, Ashbeck A . Patterns and Predictors of Compliance in a Prospective Diary Study of Substance Use and Sexual Behavior in a Sample of Young Men Who Have Sex With Men. Assessment. 2016; 25(4):403-414. PMC: 5565708. DOI: 10.1177/1073191116667584. View

11.

Ansell E, Laws H, Roche M, Sinha R . Effects of marijuana use on impulsivity and hostility in daily life. Drug Alcohol Depend. 2015; 148:136-42. PMC: 4330120. DOI: 10.1016/j.drugalcdep.2014.12.029. View

12.

Morren M, van Dulmen S, Ouwerkerk J, Bensing J . Compliance with momentary pain measurement using electronic diaries: a systematic review. Eur J Pain. 2008; 13(4):354-65. DOI: 10.1016/j.ejpain.2008.05.010. View

13.

Hasselhorn K, Ottenstein C, Lischetzke T . The effects of assessment intensity on participant burden, compliance, within-person variance, and within-person relationships in ambulatory assessment. Behav Res Methods. 2021; 54(4):1541-1558. PMC: 9374628. DOI: 10.3758/s13428-021-01683-6. View

14.

de Vries L, Baselmans B, Bartels M . Smartphone-Based Ecological Momentary Assessment of Well-Being: A Systematic Review and Recommendations for Future Studies. J Happiness Stud. 2021; 22(5):2361-2408. PMC: 8550316. DOI: 10.1007/s10902-020-00324-7. View

15.

Fuller-Tyszkiewicz M, Skouteris H, Richardson B, Blore J, Holmes M, Mills J . Does the burden of the experience sampling method undermine data quality in state body image research?. Body Image. 2013; 10(4):607-13. DOI: 10.1016/j.bodyim.2013.06.003. View

16.

Burg M, Schwartz J, Kronish I, Diaz K, Alcantara C, Duer-Hefele J . Does Stress Result in You Exercising Less? Or Does Exercising Result in You Being Less Stressed? Or Is It Both? Testing the Bi-directional Stress-Exercise Association at the Group and Person (N of 1) Level. Ann Behav Med. 2017; 51(6):799-809. PMC: 5597451. DOI: 10.1007/s12160-017-9902-4. View

17.

Eisele G, Vachon H, Lafit G, Kuppens P, Houben M, Myin-Germeys I . The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population. Assessment. 2020; 29(2):136-151. DOI: 10.1177/1073191120957102. View

18.

Gloster A, Miche M, Wersebe H, Mikoteit T, Hoyer J, Imboden C . Daily fluctuation of emotions and memories thereof: Design and methods of an experience sampling study of major depression, social phobia, and controls. Int J Methods Psychiatr Res. 2017; 26(3). PMC: 6877193. DOI: 10.1002/mpr.1578. View

19.

Stone A, Broderick J, Schwartz J, Shiffman S, Litcher-Kelly L, Calvanese P . Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction. Pain. 2003; 104(1-2):343-51. DOI: 10.1016/s0304-3959(03)00040-x. View

20.

Rintala A, Wampers M, Myin-Germeys I, Viechtbauer W . Response compliance and predictors thereof in studies using the experience sampling method. Psychol Assess. 2018; 31(2):226-235. DOI: 10.1037/pas0000662. View