Evidence-based Practice in School Substance Use Prevention: Fidelity of Implementation Under Real-world Conditions

Overview

Journal Health Educ Res

Publisher Oxford University Press

Specialty Medical Education

Date 2011 Mar 9

PMID 21382882

Citations 28

Authors

S T Ennett

S Haws

C L Ringwalt

A A Vincus

S Hanley

J M Bowling

L A Rohrbach

Affiliations

Soon will be listed here.

Abstract

Fidelity of program implementation under real-world conditions is a critical issue in the dissemination of evidence-based school substance use prevention curricula. Program effects are diminished when programs are implemented with poor fidelity. We assessed five domains of fidelity--adherence, exposure (dosage), quality of delivery, participant responsiveness and program differentiation (lack of contamination from other programs)--in a subset of respondents (N = 342) from a national random sample of public schools with middle school grades (N = 1721). Respondents taught 1 of 10 evidence-based universal substance use prevention programs as their primary program during the 2004-05 school year. Their responses to survey questions about their recent implementation practices indicated that fidelity was high for quality of delivery and participant responsiveness, low for program differentiation and modest for adherence and exposure--the two core domains of fidelity. Results suggest the need for continued emphasis on fidelity in program materials, trainings and on-going technical support. Particular attention should be paid to supporting use of interactive delivery strategies.

Citing Articles

Feasibility of using real-world data to emulate substance use disorder clinical trials: a cross-sectional study.

Janda G, Jeffery M, Ramachandran R, Ross J, Wallach J BMC Med Res Methodol. 2024; 24(1):187.

PMID: 39198727 PMC: 11351457. DOI: 10.1186/s12874-024-02307-1.

Acceptability, feasibility and fidelity of the culturally adapted version of Unplugged ("Yo Se Lo Que Quiero"), a substance use preventive program among adolescents in Chile: a pilot randomized controlled study.

Salgado G, Gaete J, Gana S, Valenzuela D, Araya R BMC Public Health. 2024; 24(1):2026.

PMID: 39075465 PMC: 11285342. DOI: 10.1186/s12889-024-19499-2.

Fidelity of D.A.R.E. Officers' Delivery of "keepin' it REAL" in Elementary & Middle School.

Beamon E, Henson R, Kelly S, Hansen W, Wyrick D Prev Sci. 2023; 24(5):985-998.

PMID: 37358751 PMC: 10409848. DOI: 10.1007/s11121-023-01548-8.

Effectiveness of a hybrid digital substance abuse prevention approach combining e-Learning and in-person class sessions.

Griffin K, Williams C, Botvin C, Sousa S, Botvin G Front Digit Health. 2022; 4:931276.

PMID: 35990017 PMC: 9381808. DOI: 10.3389/fdgth.2022.931276.

Styles of Adaptation: The Impact of Frequency and Valence of Adaptation on Preventing Substance Use.

Hansen W, Pankratz M, Dusenbury L, Giles S, Bishop D, Albritton J Health Educ (Lond). 2022; 113(4):345-363.

PMID: 35974959 PMC: 9377654. DOI: 10.1108/09654281311329268.

References

Goldberg Lillehoj C, Griffin K, Spoth R . Program provider and observer ratings of school-based preventive intervention implementation: agreement and relation to youth outcomes. Health Educ Behav. 2004; 31(2):242-57. DOI: 10.1177/1090198103260514. View

Hallfors D, Godette D . Will the 'principles of effectiveness' improve prevention practice? Early findings from a diffusion study. Health Educ Res. 2002; 17(4):461-70. DOI: 10.1093/her/17.4.461. View

Dusenbury L, Brannigan R, Hansen W, Walsh J, Falco M . Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2004; 20(3):308-13. DOI: 10.1093/her/cyg134. View

Sloboda Z, Stephens P, Pyakuryal A, Teasdale B, Stephens R, Hawthorne R . Implementation fidelity: the experience of the Adolescent Substance Abuse Prevention Study. Health Educ Res. 2008; 24(3):394-406. DOI: 10.1093/her/cyn035. View

Rohrbach L, Dent C, Skara S, Sun P, Sussman S . Fidelity of implementation in Project Towards No Drug Abuse (TND): a comparison of classroom teachers and program specialists. Prev Sci. 2006; 8(2):125-32. PMC: 3119706. DOI: 10.1007/s11121-006-0056-z. View

Ringwalt C, Ennett S, Vincus A, Thorne J, Rohrbach L, Simons-Rudolph A . The prevalence of effective substance use prevention curricula in U.S. middle schools. Prev Sci. 2002; 3(4):257-65. DOI: 10.1023/a:1020872424136. View

Resnicow K, Davis M, Smith M, Baranowski T, Baranowski J, Doyle C . How best to measure implementation of school health curricula: a comparison of three measures. Health Educ Res. 1998; 13(2):239-50. DOI: 10.1093/her/13.2.239. View

Hansen W, McNeal Jr R . Drug education practice: results of an observational study. Health Educ Res. 1999; 14(1):85-97. DOI: 10.1093/her/14.1.85. View

Botvin G . Advancing prevention science and practice: challenges, critical issues, and future directions. Prev Sci. 2004; 5(1):69-72. DOI: 10.1023/b:prev.0000013984.83251.8b. View

10.

Rohrbach L, Graham J, Hansen W . Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993; 22(2):237-60. DOI: 10.1006/pmed.1993.1020. View

11.

Botvin G, Baker E, Dusenbury L, Botvin E, Diaz T . Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA. 1995; 273(14):1106-12. View

12.

Ennett S, Ringwalt C, Thorne J, Rohrbach L, Vincus A, Simons-Rudolph A . A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prev Sci. 2003; 4(1):1-14. DOI: 10.1023/a:1021777109369. View

13.

Elliott D, Mihalic S . Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004; 5(1):47-53. DOI: 10.1023/b:prev.0000013981.28071.52. View

14.

Hansen W, Graham J, Wolkenstein B, Rohrbach L . Program integrity as a moderator of prevention program effectiveness: results for fifth-grade students in the adolescent alcohol prevention trial. J Stud Alcohol. 1991; 52(6):568-79. DOI: 10.15288/jsa.1991.52.568. View

15.

Skara S, Rohrbach L, Sun P, Sussman S . An evaluation of the fidelity of implementation of a school-based drug abuse prevention program: project toward no drug abuse (TND). J Drug Educ. 2006; 35(4):305-29. DOI: 10.2190/4LKJ-NQ7Y-PU2A-X1BK. View

16.

Ringwalt C, Vincus A, Hanley S, Ennett S, Bowling J, Haws S . The prevalence of evidence-based drug use prevention curricula in U.S. middle schools in 2008. Prev Sci. 2010; 12(1):63-9. PMC: 3032820. DOI: 10.1007/s11121-010-0184-3. View

17.

Dusenbury L, Brannigan R, Falco M, Hansen W . A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003; 18(2):237-56. DOI: 10.1093/her/18.2.237. View

18.

Stead M, Stradling R, MacNeil M, MacKintosh A, Minty S . Implementation evaluation of the Blueprint multi-component drug prevention programme: fidelity of school component delivery. Drug Alcohol Rev. 2007; 26(6):653-64. DOI: 10.1080/09595230701613809. View

19.

Mihalic S, Fagan A, Argamaso S . Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity. Implement Sci. 2008; 3:5. PMC: 2265741. DOI: 10.1186/1748-5908-3-5. View

20.

HARRINGTON N, Giles S, Hoyle R, Feeney G, Yungbluth S . Evaluation of the All Stars character education and problem behavior prevention program: effects on mediator and outcome variables for middle school students. Health Educ Behav. 2001; 28(5):533-46. DOI: 10.1177/109019810102800502. View