Translational Research in South Africa: Evaluating Implementation Quality Using a Factorial Design

Overview

Journal Child Youth Care Forum

Specialty Pediatrics

Date 2012 Jun 19

PMID 22707870

Citations 16

Authors

Linda L Caldwell

Edward A Smith

Linda M Collins

John W Graham

Mary Lai

Lisa Wegner

Tania Vergnani

Catherine Matthews

Joachim Jacobs

Affiliations

Soon will be listed here.

Abstract

BACKGROUND: HealthWise South Africa: Life Skills for Adolescents (HW) is an evidence-based substance use and sexual risk prevention program that emphasizes the positive use of leisure time. Since 2000, this program has evolved from pilot testing through an efficacy trial involving over 7,000 youth in the Cape Town area. Beginning in 2011, through 2015, we are undertaking a new study that expands HW to all schools in the Metro South Education District. OBJECTIVE: This paper describes a research study designed in partnership with our South African collaborators that examines three factors hypothesized to affect the quality and fidelity of HW implementation: enhanced teacher training; teacher support, structure and supervision; and enhanced school environment. METHODS: Teachers and students from 56 schools in the Cape Town area will participate in this study. Teacher observations are the primary means of collecting data on factors affecting implementation quality. These factors address the practical concerns of teachers and schools related to likelihood of use and cost-effectiveness, and are hypothesized to be "active ingredients" related to high-quality program implementation in real-world settings. An innovative factorial experimental design was chosen to enable estimation of the individual effect of each of the three factors. RESULTS: Because this paper describes the conceptualization of our study, results are not yet available. CONCLUSIONS: The results of this study may have both substantive and methodological implications for advancing Type 2 translational research.

Citing Articles

Intervention Optimization: A Paradigm Shift and Its Potential Implications for Clinical Psychology.

Collins L, Nahum-Shani I, Guastaferro K, Strayhorn J, Vanness D, Murphy S Annu Rev Clin Psychol. 2024; 20(1):21-47.

PMID: 38316143 PMC: 11245367. DOI: 10.1146/annurev-clinpsy-080822-051119.

Optimization Methods and Implementation Science: An Opportunity for Behavioral and Biobehavioral Interventions.

Guastaferro K, Collins L Implement Res Pract. 2023; 2:26334895211054363.

PMID: 37089990 PMC: 9978651. DOI: 10.1177/26334895211054363.

Adolescent Substance Use Behavior Change Through School Intervention Is Improved by Teacher and School Implementation Support Together, Especially for Girls.

Layland E, Caldwell L, Ram N, Smith E, Wegner L, Jacobs J Prev Sci. 2022; 23(7):1251-1263.

PMID: 35713739 PMC: 9949964. DOI: 10.1007/s11121-022-01394-0.

The multiphase optimization strategy (MOST) in child maltreatment prevention research.

Guastaferro K, Strayhorn J, Collins L J Child Fam Stud. 2021; 30(10):2481-2491.

PMID: 34887652 PMC: 8654128. DOI: 10.1007/s10826-021-02062-7.

Parenting Practice, Leisure Experience, and Substance Use Among South African Adolescents.

Xie H, Weybright E, Caldwell L, Wegner L, Smith E J Leis Res. 2020; 51(1):36-55.

PMID: 32981966 PMC: 7518372. DOI: 10.1080/00222216.2019.1620144.

References

Patrick M, Collins L, Smith E, Caldwell L, Flisher A, Wegner L . A prospective longitudinal model of substance use onset among South African adolescents. Subst Use Misuse. 2009; 44(5):647-62. PMC: 2796627. DOI: 10.1080/10826080902810244. View

Bradshaw C, Koth C, Thornton L, Leaf P . Altering school climate through school-wide Positive Behavioral Interventions and Supports: findings from a group-randomized effectiveness trial. Prev Sci. 2008; 10(2):100-15. DOI: 10.1007/s11121-008-0114-9. View

Collins L, Baker T, Mermelstein R, Piper M, Jorenby D, Smith S . The multiphase optimization strategy for engineering effective tobacco use interventions. Ann Behav Med. 2010; 41(2):208-26. PMC: 3053423. DOI: 10.1007/s12160-010-9253-x. View

Han S, Weiss B . Sustainability of teacher implementation of school-based mental health programs. J Abnorm Child Psychol. 2005; 33(6):665-79. DOI: 10.1007/s10802-005-7646-2. View

Durlak J, DuPre E . Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008; 41(3-4):327-50. DOI: 10.1007/s10464-008-9165-0. View

Collins L, Dziak J, Li R . Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol Methods. 2009; 14(3):202-24. PMC: 2796056. DOI: 10.1037/a0015826. View

Storr C, Ialongo N, Kellam S, Anthony J . A randomized controlled trial of two primary school intervention strategies to prevent early onset tobacco smoking. Drug Alcohol Depend. 2002; 66(1):51-60. DOI: 10.1016/s0376-8716(01)00184-3. View

Palen L, Smith E, Flisher A, Caldwell L, Mpofu E . Substance use and sexual risk behavior among South African eighth grade students. J Adolesc Health. 2006; 39(5):761-3. DOI: 10.1016/j.jadohealth.2006.04.016. View

Collins L, Murphy S, Nair V, Strecher V . A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005; 30(1):65-73. DOI: 10.1207/s15324796abm3001_8. View

10.

Gager P, Elias M . Implementing prevention programs in high-risk environments: application of the resiliency paradigm. Am J Orthopsychiatry. 1997; 67(3):363-73. DOI: 10.1037/h0080239. View

11.

Fagan A, Hanson K, Hawkins J, Arthur M . Bridging science to practice: achieving prevention program implementation fidelity in the community youth development study. Am J Community Psychol. 2008; 41(3-4):235-49. DOI: 10.1007/s10464-008-9176-x. View

12.

Payne A, Gottfredson D, Gottfredson G . School predictors of the intensity of implementation of school-based prevention programs: results from a national study. Prev Sci. 2006; 7(2):225-37. DOI: 10.1007/s11121-006-0029-2. View

13.

. The effects of a multiyear universal social-emotional learning program: The role of student and school characteristics. J Consult Clin Psychol. 2010; 78(2):156-68. PMC: 3534742. DOI: 10.1037/a0018607. View

14.

Harshbarger C, Simmons G, Coelho H, Sloop K, Collins C . An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. AIDS Educ Prev. 2006; 18(4 Suppl A):184-97. DOI: 10.1521/aeap.2006.18.supp.184. View

15.

Dusenbury L, Brannigan R, Hansen W, Walsh J, Falco M . Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2004; 20(3):308-13. DOI: 10.1093/her/cyg134. View

16.

Palen L, Smith E, Caldwell L, Mathews C, Vergnani T . Transitions to substance use and sexual intercourse among South african high school students. Subst Use Misuse. 2009; 44(13):1872-87. DOI: 10.3109/10826080802544547. View

17.

Dusenbury L, Brannigan R, Falco M, Hansen W . A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003; 18(2):237-56. DOI: 10.1093/her/18.2.237. View

18.

Meintjes H, Hall K, Marera D, Boulle A . Orphans of the AIDS epidemic? The extent, nature and circumstances of child-headed households in South Africa. AIDS Care. 2010; 22(1):40-9. PMC: 2840873. DOI: 10.1080/09540120903033029. View

19.

Coffman D, Smith E, Flisher A, Caldwell L . Effects of HealthWise South Africa on condom use self-efficacy. Prev Sci. 2011; 12(2):162-72. PMC: 3102775. DOI: 10.1007/s11121-010-0196-z. View

20.

Kumpfer K, Alvarado R, Whiteside H . Family-based interventions for substance use and misuse prevention. Subst Use Misuse. 2003; 38(11-13):1759-87. DOI: 10.1081/ja-120024240. View