Process Evaluation of a Structured E-parenting Support (STEPS) in the OPTIMA Randomised Controlled Trial: a Protocol

Overview

Journal BMJ Open

Specialty General Medicine

Date 2024 May 17

PMID 38760045

Authors

Ellen Hedstrom

Katarzyna Kostyrka-Allchorne

Blandine French

Cristine Glazebrook

Charlotte Lucy Hall

Hanna Kovshoff

Nancy Lean

Edmund Sonuga-Barke

Affiliations

Soon will be listed here.

Abstract

Introduction: (STEPS) is a digital application (app) designed to help parents manage behaviour of their children who are referred to mental health services and are waiting for an assessment or treatment. STEPS is currently being evaluated in the Online Parent Training for the Initial Management of Attention-Deficit/Hyperactivity Disorder randomised controlled trial. Alongside the examination of STEPS' clinical and cost-effectiveness, we are conducting a process evaluation to better understand the contextual factors that may influence study outcomes. The purpose of this protocol is to describe the aims, objectives and methodology of the process evaluation prior to it taking place to add to the fidelity and rigour of the trial process and outcomes. Our goal is to adapt STEPS to optimise its benefits in future applications.

Methods: In line with the Medical Research Council guidelines for evaluating complex interventions, the process evaluation will adopt a mixed method design using qualitative data collected from clinicians and parent interviews and app usage data from participants assigned to the intervention arm.

Analysis: Qualitative data from semistructured interviews and free text box responses included in trial questionnaires will be analysed thematically using framework analysis to better understand how parents use STEPS, how it works and key factors that could aid or hinder its effective implementation in routine clinical practice.

Ethics: The application for ethical approval for the study was submitted to the North West-Liverpool Central Research Ethics Committee and received a favourable opinion on further information on 26 November 2021, reference number 21/NW/0319.

Dissemination: The process evaluation aims to explore how a digital app might support parents in managing their child's behaviour. Implications for policy and research will be explored and the clinical implications of offering the app to a wider audience to address the lack of support to parents as highlighted in this paper. We plan to publish findings in international, peer-reviewed journals as well as present at conferences.

Trial Registration Number: The trial has been prospectively registered on 18 November 2021; ISRCTN816523503. https://www.isrctn.com/ISRCTN16523503.

References

Barrett B, Byford S, Sharac J, Hudry K, Leadbitter K, Temple K . Service and wider societal costs of very young children with autism in the UK. J Autism Dev Disord. 2011; 42(5):797-804. DOI: 10.1007/s10803-011-1306-x. View

Murray E, Hekler E, Andersson G, Collins L, Doherty A, Hollis C . Evaluating Digital Health Interventions: Key Questions and Approaches. Am J Prev Med. 2016; 51(5):843-851. PMC: 5324832. DOI: 10.1016/j.amepre.2016.06.008. View

Daley D, Van der Oord S, Ferrin M, Danckaerts M, Doepfner M, Cortese S . Behavioral interventions in attention-deficit/hyperactivity disorder: a meta-analysis of randomized controlled trials across multiple outcome domains. J Am Acad Child Adolesc Psychiatry. 2014; 53(8):835-47, 847.e1-5. DOI: 10.1016/j.jaac.2014.05.013. View

Gale N, Heath G, Cameron E, Rashid S, Redwood S . Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013; 13:117. PMC: 3848812. DOI: 10.1186/1471-2288-13-117. View

Swanson J, Kraemer H, Hinshaw S, Arnold L, Conners C, Abikoff H . Clinical relevance of the primary findings of the MTA: success rates based on severity of ADHD and ODD symptoms at the end of treatment. J Am Acad Child Adolesc Psychiatry. 2001; 40(2):168-79. DOI: 10.1097/00004583-200102000-00011. View

Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W . Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015; 350:h1258. PMC: 4366184. DOI: 10.1136/bmj.h1258. View

Gullhav A, Skomsvoll J, Heimstad R, Schultz J . Reducing waiting times from 65 to under 40 days for children and adolescents receiving mental health services using a new scheduling policy. Health Serv Manage Res. 2022; 36(4):249-261. DOI: 10.1177/09514848221122895. View

Goodman R . The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997; 38(5):581-6. DOI: 10.1111/j.1469-7610.1997.tb01545.x. View

Hartman R, Stage S, Webster-Stratton C . A growth curve analysis of parent training outcomes: examining the influence of child risk factors (inattention, impulsivity, and hyperactivity problems), parental and family risk factors. J Child Psychol Psychiatry. 2003; 44(3):388-98. DOI: 10.1111/1469-7610.00129. View

10.

Chan A, Tetzlaff J, Altman D, Laupacis A, Gotzsche P, Krleza-Jeric K . SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013; 158(3):200-7. PMC: 5114123. DOI: 10.7326/0003-4819-158-3-201302050-00583. View

11.

Garbacz L, Brown D, Spee G, Polo A, Budd K . Establishing treatment fidelity in evidence-based parent training programs for externalizing disorders in children and adolescents. Clin Child Fam Psychol Rev. 2014; 17(3):230-47. DOI: 10.1007/s10567-014-0166-2. View

12.

Ball W, Black C, Gordon S, Ostrovska B, Paranjothy S, Rasalam A . Inequalities in children's mental health care: analysis of routinely collected data on prescribing and referrals to secondary care. BMC Psychiatry. 2023; 23(1):22. PMC: 9831880. DOI: 10.1186/s12888-022-04438-5. View

13.

Johnson M, Gillberg C, Vinsa I, Fransson G, Samuelsson L, Jakobsson K . A randomized controlled trial of a new intervention in early symptomatic syndromes eliciting neurodevelopmental clinical examinations: PR-ESSENCE. Eur Child Adolesc Psychiatry. 2021; 32(1):63-74. PMC: 9908639. DOI: 10.1007/s00787-021-01837-z. View

14.

Kostyrka-Allchorne K, Ballard C, Byford S, Cortese S, Daley D, Downs J . Online Parent Training for The Initial Management of ADHD referrals (OPTIMA): the protocol for a randomised controlled trial of a digital parenting intervention implemented to support parents and children on a treatment waitlist. Trials. 2022; 23(1):1003. PMC: 9744042. DOI: 10.1186/s13063-022-06952-z. View

15.

Fridman M, Banaschewski T, Sikirica V, Quintero J, Chen K . Access to diagnosis, treatment, and supportive services among pharmacotherapy-treated children/adolescents with ADHD in Europe: data from the Caregiver Perspective on Pediatric ADHD survey. Neuropsychiatr Dis Treat. 2017; 13:947-958. PMC: 5384740. DOI: 10.2147/NDT.S128752. View

16.

Jensen P, Martin D, Cantwell D . Comorbidity in ADHD: implications for research, practice, and DSM-V. J Am Acad Child Adolesc Psychiatry. 1997; 36(8):1065-79. DOI: 10.1097/00004583-199708000-00014. View

17.

Reardon T, Harvey K, Baranowska M, OBrien D, Smith L, Creswell C . What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017; 26(6):623-647. PMC: 5446558. DOI: 10.1007/s00787-016-0930-6. View

18.

Kostyrka-Allchorne K, Chu P, Ballard C, Lean N, French B, Hedstrom E . Remote Recruitment Strategy and Structured E-Parenting Support (STEPS) App: Feasibility and Usability Study. JMIR Pediatr Parent. 2023; 6:e47035. PMC: 10520770. DOI: 10.2196/47035. View

19.

Duffy A, Christie G, Moreno S . The Challenges Toward Real-world Implementation of Digital Health Design Approaches: Narrative Review. JMIR Hum Factors. 2022; 9(3):e35693. PMC: 9508664. DOI: 10.2196/35693. View

20.

Dalrymple R, McKenna Maxwell L, Russell S, Duthie J . NICE guideline review: Attention deficit hyperactivity disorder: diagnosis and management (NG87). Arch Dis Child Educ Pract Ed. 2019; 105(5):289-293. DOI: 10.1136/archdischild-2019-316928. View