Positive Attitude Upper Middle School Social and Emotional Learning Program: Influences of Implementation Quality on Program Outcome

Overview

Journal Front Psychol

Date 2023 Jun 2

PMID 37265944

Authors

Vitor Alexandre Coelho

Marta Marchante

Patricia Bras

Affiliations

Soon will be listed here.

Abstract

Introduction: There is an increased call for studies analyzing how implementation quality influences Social and Emotional Learning (SEL) program effectiveness.

Methods: The current dissemination study analyzed the effectiveness of the Positive Attitude Upper Middle School SEL program on a Portuguese nationwide sample composed of 813 middle school students (7th and 8th grade; 51.7% boys; = 12.41, = 1.06), from 36 classrooms ( = 22.58; = 2.86), distributed between the control group (179 students), and three intervention groups (643 students) that reflected low, middle, and high implementer experience (respectively, Gulbenkian Academies of Knowledge, Positive Attitude Cadaval and Positive Attitude Torres Vedras). Dosage and fidelity (as implementation quality dimensions), gender, and classroom size (as individual and classroom-level variables) were also analyzed. Self-report questionnaires were administered pre- and post-intervention and at a 6-month follow-up.

Results: Multilevel models were employed, and results showed that participating in the PAUMS SEL program led to more positive trajectories in self-control, social awareness, relationship skills, and responsible decision-making when compared with control groups. Regarding implementation quality, only the implementer's experience impacted the effectiveness of the PAUMS SEL program; students in the Gulbenkian Academies of Knowledge intervention group displayed a less positive trajectory in self-control than students in the Positive Attitude Torres Vedras intervention group.

Discussion: Altogether, results showed that the PAUMS SEL program is ready for dissemination in Portugal, although a higher level of implementer experience is needed to achieve the best effectiveness, and they support the importance of analyzing implementer experience in SEL programs' effectiveness studies.

References

St Pierre T, Osgood D, Siennick S, Kauh T, Burden F . Project ALERT with outside leaders: what leader characteristics are important for success?. Prev Sci. 2006; 8(1):51-64. DOI: 10.1007/s11121-006-0055-0. View

Domitrovich C, Li Y, Mathis E, Greenberg M . Individual and organizational factors associated with teacher self-reported implementation of the PATHS curriculum. J Sch Psychol. 2019; 76:168-185. DOI: 10.1016/j.jsp.2019.07.015. View

Coelho V, Sousa V, Raimundo R, Figueira A . The impact of a Portuguese middle school social-emotional learning program. Health Promot Int. 2015; 32(2):292-300. DOI: 10.1093/heapro/dav064. View

Dowling K, Barry M . Evaluating the Implementation Quality of a Social and Emotional Learning Program: A Mixed Methods Approach. Int J Environ Res Public Health. 2020; 17(9). PMC: 7246810. DOI: 10.3390/ijerph17093249. View

Cross W, West J . Examining implementer fidelity: Conceptualizing and measuring adherence and competence. J Child Serv. 2011; 6(1):18-33. PMC: 3171488. DOI: 10.5042/jcs.2011.0123. View

Dane A, Schneider B . Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clin Psychol Rev. 1998; 18(1):23-45. DOI: 10.1016/s0272-7358(97)00043-3. View

Rao N, Fisher P . The impact of the COVID-19 pandemic on child and adolescent development around the world. Child Dev. 2021; 92(5):e738-e748. PMC: 8652930. DOI: 10.1111/cdev.13653. View

Coelho V, Sousa V . Differential Effectiveness of a Middle School Social and Emotional Learning Program: Does Setting Matter?. J Youth Adolesc. 2018; 47(9):1978-1991. DOI: 10.1007/s10964-018-0897-3. View

Wahl M, Adelson J, Patak M, Possel P, Hautzinger M . Teachers or psychologists: who should facilitate depression prevention programs in schools?. Int J Environ Res Public Health. 2014; 11(5):5294-316. PMC: 4053918. DOI: 10.3390/ijerph110505294. View

10.

Sentse M, Veenstra R, Kiuru N, Salmivalli C . A Longitudinal Multilevel Study of Individual Characteristics and Classroom Norms in Explaining Bullying Behaviors. J Abnorm Child Psychol. 2014; 43(5):943-55. DOI: 10.1007/s10802-014-9949-7. View

11.

Bradshaw C, Shukla K, Pas E, Berg J, Ialongo N . Using Complier Average Causal Effect Estimation to Examine Student Outcomes of the PAX Good Behavior Game When Integrated with the PATHS Curriculum. Adm Policy Ment Health. 2020; 47(6):972-986. DOI: 10.1007/s10488-020-01034-1. View

12.

Durlak J, DuPre E . Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008; 41(3-4):327-50. DOI: 10.1007/s10464-008-9165-0. View

13.

Durlak J, Weissberg R, Dymnicki A, Taylor R, Schellinger K . The impact of enhancing students' social and emotional learning: a meta-analysis of school-based universal interventions. Child Dev. 2011; 82(1):405-32. DOI: 10.1111/j.1467-8624.2010.01564.x. View

14.

Domitrovich C, Bradshaw C, Poduska J, Hoagwood K, Buckley J, Olin S . Maximizing the Implementation Quality of Evidence-Based Preventive Interventions in Schools: A Conceptual Framework. Adv Sch Ment Health Promot. 2016; 1(3):6-28. PMC: 4865398. DOI: 10.1080/1754730x.2008.9715730. View

15.

Evans R, Murphy S, Scourfield J . Implementation of a school-based social and emotional learning intervention: understanding diffusion processes within complex systems. Prev Sci. 2015; 16(5):754-64. PMC: 4452595. DOI: 10.1007/s11121-015-0552-0. View

16.

Taylor R, Oberle E, Durlak J, Weissberg R . Promoting Positive Youth Development Through School-Based Social and Emotional Learning Interventions: A Meta-Analysis of Follow-Up Effects. Child Dev. 2017; 88(4):1156-1171. DOI: 10.1111/cdev.12864. View

17.

Coelho V, Marchante M, Sousa V . "Positive Attitude": A multilevel model analysis of the effectiveness of a Social and Emotional Learning Program for Portuguese middle school students. J Adolesc. 2015; 43:29-38. DOI: 10.1016/j.adolescence.2015.05.009. View

18.

Ialongo N, Domitrovich C, Embry D, Greenberg M, Lawson A, Becker K . A randomized controlled trial of the combination of two school-based universal preventive interventions. Dev Psychol. 2019; 55(6):1313-1325. DOI: 10.1037/dev0000715. View

19.

Cooper B, Bumbarger B, Moore J . Sustaining evidence-based prevention programs: correlates in a large-scale dissemination initiative. Prev Sci. 2013; 16(1):145-57. DOI: 10.1007/s11121-013-0427-1. View