Impact of Learning Health Systems on Cross-system Collaboration Between Youth Legal and Community Mental Health Systems: a Type II Hybrid Effectiveness-implementation Trial

Overview

Journal Implement Sci Commun

Publisher Biomed Central

Specialty Health Services

Date 2024 Dec 24

PMID 39719625

Authors

Lauren OReilly

Dayu Sun

Katherine Schwartz

Logan Gillenwater

Allyson Dir

Patrick Monahan

Gregory A Aarons

Lisa Saldana

Zachary Adams

Tamika Zapolski

Leslie Hulvershorn

Matthew C Aalsma

Affiliations

Soon will be listed here.

Abstract

Background: Youth involved in the legal system have disproportionately higher rates of problematic substance use than non-involved youth. Identifying and connecting legal-involved youth to substance use intervention is critical and relies on the connection between legal and behavioral health agencies, which may be facilitated by learning health systems (LHS). We analyzed the impact of an LHS intervention on youth legal and behavioral health personnel ratings of their cross-system collaboration. We also examined organizational climate toward evidence-based practice (EBP) over and above the LHS intervention.

Methods: Data were derived from a type II hybrid effectiveness trial implementing an LHS intervention with youth legal and community mental health centers (CMHCs) in eight Indiana counties. Using a stepped wedge design, counties were randomly assigned to one of three cohorts and stepped in at nine-month intervals. Counties were in the treatment phase for 18 months, after which they were in the maintenance phase. Youth legal system and CMHC personnel completed five waves of data collection (n=307 total respondents, ranging from 108-178 per wave). Cross-system collaboration was measured via the Cultural Exchange Inventory, organizational EBP climate via the Implementation Climate Scale and Implementation Citizenship Behavior Scale, and intervention via a dummy-coded indicator variable. We conducted linear mixed models to examine: 1) the treatment indicator, and 2) the treatment indicator and organizational EBP climate variables on cross-system collaboration.

Results: The treatment indicator was not significantly associated with cross-system collaboration. When including the organizational EBP climate variables, the treatment indicator significantly predicted cross-system collaboration. Compared to the control phase, treatment (B=0.41, standard error [SE]=0.20) and maintenance (B=0.60, SE=0.29) phases were associated with greater cross-system collaboration output.

Conclusions: The analysis may have been underpowered to detect an effect; third variables may have explained variance in cross-system collaboration, and, thus, the inclusion of important covariates may have reduced residual errors and increased the estimation precision. The LHS intervention may have affected cross-system collaboration perception and offers a promising avenue of research to determine how systems work together to improve legal-involved-youth substance use outcomes. Future research is needed to replicate results among a larger sample and examine youth-level outcomes.

Trial Registration: Clinicaltrials.gov identifier: NCT04499079. Registered 30 July 2020. https://clinicaltrials.gov/study/NCT04499079 .

References

Belenko S, Knight D, Wasserman G, Dennis M, Wiley T, Taxman F . The Juvenile Justice Behavioral Health Services Cascade: A new framework for measuring unmet substance use treatment services needs among adolescent offenders. J Subst Abuse Treat. 2017; 74:80-91. PMC: 5298399. DOI: 10.1016/j.jsat.2016.12.012. View

Borge R, Skar A, Endsjo M, Egeland K . Good soldiers in implementation: validation of the Implementation Citizenship Behavior Scale and its relation to implementation leadership and intentions to use evidence-based practices. Implement Sci Commun. 2021; 2(1):136. PMC: 8665530. DOI: 10.1186/s43058-021-00240-8. View

Ehrhart M, Torres E, Hwang J, Sklar M, Aarons G . Validation of the Implementation Climate Scale (ICS) in substance use disorder treatment organizations. Subst Abuse Treat Prev Policy. 2019; 14(1):35. PMC: 6708170. DOI: 10.1186/s13011-019-0222-5. View

Ehrhart M, Aarons G, Farahnak L . Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014; 9:157. PMC: 4210525. DOI: 10.1186/s13012-014-0157-1. View

Hemming K, Taljaard M . Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?. Int J Epidemiol. 2020; 49(3):1043-1052. PMC: 7394949. DOI: 10.1093/ije/dyaa077. View

Prinz R, Kerns S . Early substance use by juvenile offenders. Child Psychiatry Hum Dev. 2003; 33(4):263-77. DOI: 10.1023/a:1023030428491. View

Belenko S, Johnson I, Taxman F, Rieckmann T . Probation Staff Attitudes Toward Substance Abuse Treatment and Evidence-Based Practices. Int J Offender Ther Comp Criminol. 2016; 62(2):313-333. DOI: 10.1177/0306624X16650679. View

Barker D, McElduff P, Deste C, Campbell M . Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016; 16:69. PMC: 4895892. DOI: 10.1186/s12874-016-0176-5. View

Scott C, Dennis M, Grella C, Funk R, Lurigio A . Juvenile justice systems of care: results of a national survey of community supervision agencies and behavioral health providers on services provision and cross-system interactions. Health Justice. 2019; 7(1):11. PMC: 6717998. DOI: 10.1186/s40352-019-0093-x. View

10.

Aarons G, Brown S, Hough R, Garland A, Wood P . Prevalence of adolescent substance use disorders across five sectors of care. J Am Acad Child Adolesc Psychiatry. 2001; 40(4):419-26. DOI: 10.1097/00004583-200104000-00010. View

11.

Flum D, Alfonso-Cristancho R, Devine E, Devlin A, Farrokhi E, Tarczy-Hornoch P . Implementation of a "real-world" learning health care system: Washington State's Comparative Effectiveness Research Translation Network (CERTAIN). Surgery. 2014; 155(5):860-6. DOI: 10.1016/j.surg.2014.01.004. View

12.

Torres E, Seijo C, Ehrhart M, Aarons G . Validation of a pragmatic measure of implementation citizenship behavior in substance use disorder treatment agencies. J Subst Abuse Treat. 2020; 111:47-53. PMC: 7064805. DOI: 10.1016/j.jsat.2020.01.002. View

13.

Carstens C, Panzano P, Massatti R, Roth D, Sweeney H . A naturalistic study of MST dissemination in 13 Ohio communities. J Behav Health Serv Res. 2008; 36(3):344-60. DOI: 10.1007/s11414-008-9124-4. View

14.

Dir A, OReilly L, Pederson C, Schwartz K, Brown S, Reda K . Early development of local data dashboards to depict the substance use care cascade for youth involved in the legal system: qualitative findings from end users. BMC Health Serv Res. 2024; 24(1):687. PMC: 11140904. DOI: 10.1186/s12913-024-11126-5. View

15.

McGinnis J, Fineberg H, Dzau V . Advancing the Learning Health System. N Engl J Med. 2021; 385(1):1-5. DOI: 10.1056/NEJMp2103872. View

16.

Funk R, Knudsen H, McReynolds L, Bartkowski J, Elkington K, Steele E . Substance use prevention services in juvenile justice and behavioral health: results from a national survey. Health Justice. 2020; 8(1):11. PMC: 7222571. DOI: 10.1186/s40352-020-00114-6. View

17.

Aalsma M, Aarons G, Adams Z, Alton M, Boustani M, Dir A . Alliances to disseminate addiction prevention and treatment (ADAPT): A statewide learning health system to reduce substance use among justice-involved youth in rural communities. J Subst Abuse Treat. 2021; 128:108368. PMC: 8883586. DOI: 10.1016/j.jsat.2021.108368. View

18.

Ehrhart M, Torres E, Wright L, Martinez S, Aarons G . Validating the Implementation Climate Scale (ICS) in child welfare organizations. Child Abuse Negl. 2015; 53:17-26. PMC: 4818155. DOI: 10.1016/j.chiabu.2015.10.017. View

19.

Johnson-Kwochka A, Dir A, Salyers M, Aalsma M . Organizational structure, climate, and collaboration between juvenile justice and community mental health centers: implications for evidence-based practice implementation for adolescent substance use disorder treatment. BMC Health Serv Res. 2020; 20(1):929. PMC: 7545946. DOI: 10.1186/s12913-020-05777-3. View

20.

Peters N, Borge R, Skar A, Egeland K . Measuring implementation climate: psychometric properties of the Implementation Climate Scale (ICS) in Norwegian mental health care services. BMC Health Serv Res. 2022; 22(1):23. PMC: 8725247. DOI: 10.1186/s12913-021-07441-w. View