Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation

Overview

Journal Prev Sci

Specialty Science

Date 2015 Apr 8

PMID 25846268

Citations 168

Authors

Denise C Gottfredson

Thomas D Cook

Frances E M Gardner

Deborah Gorman-Smith

George W Howe

Irwin N Sandler

Kathryn M Zafft

Affiliations

Soon will be listed here.

Abstract

A decade ago, the Society of Prevention Research (SPR) endorsed a set of standards for evidence related to research on prevention interventions. These standards (Flay et al., Prevention Science 6:151-175, 2005) were intended in part to increase consistency in reviews of prevention research that often generated disparate lists of effective interventions due to the application of different standards for what was considered to be necessary to demonstrate effectiveness. In 2013, SPR's Board of Directors decided that the field has progressed sufficiently to warrant a review and, if necessary, publication of "the next generation" of standards of evidence. The Board convened a committee to review and update the standards. This article reports on the results of this committee's deliberations, summarizing changes made to the earlier standards and explaining the rationale for each change. The SPR Board of Directors endorses "The Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation."

Citing Articles

Training and Technical Assistance Increase the Fidelity of Implementation of a Universal Prevention Initiative in Rural Schools: Results from a 3-Year Cluster-Randomized Trial.

Calvert H, Fleming C, Lowe M, Lewis T, Siebert C, Havlicak A Prev Sci. 2025; 26(1):56-68.

PMID: 39899222 PMC: 11811254. DOI: 10.1007/s11121-025-01776-0.

Applying an Equity Lens to Evidence-Based Preventive Interventions: a Systematic Review of Subgroup Findings from Experimental Evaluations.

Buckley P, Gust C, Coffin S, Aikawa S, Steeger C, Pampel F Prev Sci. 2025; 26(1):93-106.

PMID: 39821577 PMC: 11811249. DOI: 10.1007/s11121-025-01765-3.

Optimizing Engagement: Factors Influencing Family Participation in a Positive Parenting Program among Vulnerable Households with Young Children.

Cebolla H, Martin J, Rodrigo M Psychosoc Interv. 2025; 34(1):53-66.

PMID: 39781015 PMC: 11705436. DOI: 10.5093/pi2025a5.

Well-being interventions for rural health professionals: A scoping review.

McKennon S, Fricke S, DeWitt D J Rural Health. 2025; 41(1):e12909.

PMID: 39757437 PMC: 11701247. DOI: 10.1111/jrh.12909.

Scaling up Attachment and Biobehavioral Catch-up with Latine families: Implementation processes and effectiveness.

Carrera P, Zablah F, de la Rosa Y, Benito-Gomez M Infant Ment Health J. 2024; 46(1):3-14.

PMID: 39503189 PMC: 11729471. DOI: 10.1002/imhj.22141.

References

Montgomery P, Underhill K, Gardner F, Operario D, Mayo-Wilson E . The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses. J Clin Epidemiol. 2013; 66(8):874-82. PMC: 3746185. DOI: 10.1016/j.jclinepi.2013.03.006. View

Ioannidis J . Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005; 294(2):218-28. DOI: 10.1001/jama.294.2.218. View

Ludwig J, Phillips D . Long-term effects of head start on low-income children. Ann N Y Acad Sci. 2007; 1136:257-68. DOI: 10.1196/annals.1425.005. View

Fagan A, Hanson K, Hawkins J, Arthur M . Translational Research in Action: Implementation of the Communities That Care Prevention System in 12 Communities. J Community Psychol. 2011; 37(7):809-829. PMC: 3222885. DOI: 10.1002/jcop.20332. View

Rohrbach L, Grana R, Sussman S, Valente T . Type II translation: transporting prevention interventions from research to real-world settings. Eval Health Prof. 2006; 29(3):302-33. DOI: 10.1177/0163278706290408. View

Spoth R, Greenberg M . Impact challenges in community science-with-practice: lessons from PROSPER on transformative practitioner-scientist partnerships and prevention infrastructure development. Am J Community Psychol. 2011; 48(1-2):106-19. PMC: 3110986. DOI: 10.1007/s10464-010-9417-7. View

Grant S, Mayo-Wilson E, Melendez-Torres G, Montgomery P . Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications. PLoS One. 2013; 8(5):e65442. PMC: 3666983. DOI: 10.1371/journal.pone.0065442. View

Pashler H, Wagenmakers E . Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?. Perspect Psychol Sci. 2015; 7(6):528-30. DOI: 10.1177/1745691612465253. View

Brown C, Wang W, Kellam S, Muthen B, Petras H, Toyinbo P . Methods for testing theory and evaluating impact in randomized field trials: intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug Alcohol Depend. 2008; 95 Suppl 1:S74-S104. PMC: 2560173. DOI: 10.1016/j.drugalcdep.2007.11.013. View

10.

Hutchings J, Gardner F, Bywater T, Daley D, Whitaker C, Jones K . Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. BMJ. 2007; 334(7595):678. PMC: 1839187. DOI: 10.1136/bmj.39126.620799.55. View

11.

Menting A, Orobio de Castro B, Matthys W . Effectiveness of the Incredible Years parent training to modify disruptive and prosocial child behavior: a meta-analytic review. Clin Psychol Rev. 2013; 33(8):901-13. DOI: 10.1016/j.cpr.2013.07.006. View

12.

Hallfors D, Godette D . Will the 'principles of effectiveness' improve prevention practice? Early findings from a diffusion study. Health Educ Res. 2002; 17(4):461-70. DOI: 10.1093/her/17.4.461. View

13.

Schafer J, Graham J . Missing data: our view of the state of the art. Psychol Methods. 2002; 7(2):147-77. View

14.

Schroeder B, Messina A, Schroeder D, Good K, Barto S, Saylor J . The implementation of a statewide bullying prevention program: preliminary findings from the field and the importance of coalitions. Health Promot Pract. 2011; 13(4):489-95. DOI: 10.1177/1524839910386887. View

15.

Griffin K, Botvin G, Nichols T . Long-term follow-up effects of a school-based drug abuse prevention program on adolescent risky driving. Prev Sci. 2004; 5(3):207-12. DOI: 10.1023/b:prev.0000037643.78420.74. View

16.

Ioannidis J . Why Science Is Not Necessarily Self-Correcting. Perspect Psychol Sci. 2015; 7(6):645-54. DOI: 10.1177/1745691612464056. View

17.

Forgatch M, DeGarmo D . Sustaining fidelity following the nationwide PMTO™ implementation in Norway. Prev Sci. 2011; 12(3):235-46. PMC: 3153633. DOI: 10.1007/s11121-011-0225-6. View

18.

Montgomery P, Grant S, Hopewell S, Macdonald G, Moher D, Michie S . Protocol for CONSORT-SPI: an extension for social and psychological interventions. Implement Sci. 2013; 8:99. PMC: 3766255. DOI: 10.1186/1748-5908-8-99. View

19.

Hedeker D, Gibbons R, Flay B . Random-effects regression models for clustered data with an example from smoking prevention research. J Consult Clin Psychol. 1994; 62(4):757-65. DOI: 10.1037//0022-006x.62.4.757. View

20.

Gottfredson D, Kumpfer K, Polizzi-Fox D, Wilson D, Puryear V, Beatty P . The Strengthening Washington D.C. Families project: a randomized effectiveness trial of family-based prevention. Prev Sci. 2006; 7(1):57-74. DOI: 10.1007/s11121-005-0017-y. View