Examining Implementer Fidelity: Conceptualizing and Measuring Adherence and Competence

Overview

Journal J Child Serv

Date 2011 Sep 17

PMID 21922026

Citations 36

Authors

Wendi F Cross

Jennifer C West

Affiliations

Soon will be listed here.

Abstract

The large gap between intervention outcomes demonstrated in efficacy trials and the apparent ineffectiveness of these same programs in community settings has prompted investigators and practitioners to look closely at implementation fidelity. Critically important, but often overlooked, are the implementers who deliver evidence-based programs -- the effectiveness of programs cannot surpass skill levels of the people implementing them. This article distinguishes fidelity at the programmatic level from implementer fidelity. Two components of implementer fidelity are defined. Implementer adherence and competence are proposed to be related but unique constructs that can be reliably measured for training¸ monitoring, and outcomes research. Observational measures from a school-based preventive intervention are provided and the unique contributions of implementer adherence and competence are illustrated. Distinguishing implementer adherence to the manual and competence in program delivery is a critical next step in child mental health program implementation research.

Citing Articles

Scoping review of fidelity strategies used in behaviour change trials delivered in primary dental care settings.

Lowers V, Kirby R, Young B, Harris R Trials. 2024; 25(1):824.

PMID: 39695740 PMC: 11653899. DOI: 10.1186/s13063-024-08659-9.

Positive Attitude Upper Middle School social and emotional learning program: influences of implementation quality on program outcome.

Coelho V, Marchante M, Bras P Front Psychol. 2023; 14:1172517.

PMID: 37265944 PMC: 10229836. DOI: 10.3389/fpsyg.2023.1172517.

Fidelity to the ACT SMART Toolkit: an instrumental case study of implementation strategy fidelity.

Tschida J, Drahota A Implement Sci Commun. 2023; 4(1):52.

PMID: 37194052 PMC: 10189967. DOI: 10.1186/s43058-023-00434-2.

A consultation with feedback approach to supporting fidelity to a peer-delivered intervention for posttraumatic stress disorder.

Valentine S, Smith A, Stewart K, Vo L, Lisle I Implement Res Pract. 2023; 2:26334895211017280.

PMID: 37090008 PMC: 9978629. DOI: 10.1177/26334895211017280.

Individual and contextual factors affect the implementation fidelity of youth-friendly services, northwest Ethiopia: A multilevel analysis.

Habitu Y, Biks G, Worku A, Gelaye K PLoS One. 2022; 17(2):e0263733.

PMID: 35143579 PMC: 8830631. DOI: 10.1371/journal.pone.0263733.

References

Harachi T, Abbott R, Catalano R, Haggerty K, Fleming C . Opening the black box: using process evaluation measures to assess implementation and theory building. Am J Community Psychol. 2000; 27(5):711-31. DOI: 10.1023/A:1022194005511. View

Carroll K, Nich C, Sifry R, Nuro K, Frankforter T, Ball S . A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug Alcohol Depend. 2000; 57(3):225-38. DOI: 10.1016/s0376-8716(99)00049-6. View

Hill L, Maucione K, Hood B . A focused approach to assessing program fidelity. Prev Sci. 2006; 8(1):25-34. DOI: 10.1007/s11121-006-0051-4. View

Davidson K, Scott J, Schmidt U, Tata P, Thornton S, Tyrer P . Therapist competence and clinical outcome in the Prevention of Parasuicide by Manual Assisted Cognitive Behaviour Therapy trial: the POPMACT study. Psychol Med. 2004; 34(5):855-63. DOI: 10.1017/s0033291703001855. View

Snyder J, Reid J, Stoolmiller M, Howe G, Brown H, Dagne G . The role of behavior observation in measurement systems for randomized prevention trials. Prev Sci. 2006; 7(1):43-56. DOI: 10.1007/s11121-005-0020-3. View

Forgatch M, Patterson G, DeGarmo D . Evaluating fidelity: predictive validity for a measure of competent adherence to the Oregon model of parent management training. Behav Ther. 2006; 36(1):3-13. PMC: 1464400. DOI: 10.1016/s0005-7894(05)80049-8. View

Hogue A, Henderson C, Dauber S, Barajas P, Fried A, Liddle H . Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. J Consult Clin Psychol. 2008; 76(4):544-55. PMC: 2843085. DOI: 10.1037/0022-006X.76.4.544. View

Wyman P, Cross W, Brown C, Yu Q, Tu X, Eberly S . Intervention to strengthen emotional self-regulation in children with emerging mental health problems: proximal impact on school behavior. J Abnorm Child Psychol. 2010; 38(5):707-20. PMC: 2880630. DOI: 10.1007/s10802-010-9398-x. View

Lochman J, Boxmeyer C, Powell N, Qu L, Wells K, Windle M . Dissemination of the Coping Power program: importance of intensity of counselor training. J Consult Clin Psychol. 2009; 77(3):397-409. DOI: 10.1037/a0014514. View

10.

Brekke J, Wolkon G . Monitoring program implementation in community mental health settings. Eval Health Prof. 1988; 11(4):425-40. DOI: 10.1177/016327878801100402. View

11.

Goldberg Lillehoj C, Griffin K, Spoth R . Program provider and observer ratings of school-based preventive intervention implementation: agreement and relation to youth outcomes. Health Educ Behav. 2004; 31(2):242-57. DOI: 10.1177/1090198103260514. View

12.

Rohrbach L, Dent C, Skara S, Sun P, Sussman S . Fidelity of implementation in Project Towards No Drug Abuse (TND): a comparison of classroom teachers and program specialists. Prev Sci. 2006; 8(2):125-32. PMC: 3119706. DOI: 10.1007/s11121-006-0056-z. View

13.

Glasgow R, Lichtenstein E, Marcus A . Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003; 93(8):1261-7. PMC: 1447950. DOI: 10.2105/ajph.93.8.1261. View

14.

Dusenbury L, Brannigan R, Falco M, Hansen W . A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003; 18(2):237-56. DOI: 10.1093/her/18.2.237. View

15.

Creed T, Kendall P . Therapist alliance-building behavior within a cognitive-behavioral treatment for anxiety in youth. J Consult Clin Psychol. 2005; 73(3):498-505. DOI: 10.1037/0022-006X.73.3.498. View

16.

Huey Jr S, Henggeler S, Brondino M, Pickrel S . Mechanisms of change in multisystemic therapy: reducing delinquent behavior through therapist adherence and improved family and peer functioning. J Consult Clin Psychol. 2000; 68(3):451-67. View

17.

McHugo G, Drake R, Whitley R, Bond G, Campbell K, Rapp C . Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatr Serv. 2007; 58(10):1279-84. DOI: 10.1176/ps.2007.58.10.1279. View

18.

Durlak J, DuPre E . Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008; 41(3-4):327-50. DOI: 10.1007/s10464-008-9165-0. View

19.

James I, Blackburn I, Milne D, Reichfelt F . Moderators of trainee therapists' competence in cognitive therapy. Br J Clin Psychol. 2001; 40(2):131-41. DOI: 10.1348/014466501163580. View

20.

Rohrbach L, Gunning M, Sun P, Sussman S . The Project Towards No Drug Abuse (TND) dissemination trial: implementation fidelity and immediate outcomes. Prev Sci. 2009; 11(1):77-88. PMC: 2822092. DOI: 10.1007/s11121-009-0151-z. View