Systematic Review and Meta-analysis of Adverse Events in Clinical Trials of Mental Health Apps

Overview

Journal NPJ Digit Med

Specialty Medical Informatics

Date 2024 Dec 18

PMID 39695173

Authors

Jake Linardon

Matthew Fuller-Tyszkiewicz

Joseph Firth

Simon B Goldberg

Cleo Anderson

Zoe McClure

John Torous

Affiliations

Soon will be listed here.

Abstract

Mental health apps are efficacious, yet they may pose risks in some. This review (CRD42024506486) examined adverse events (AEs) from mental health apps. We searched (May 2024) the Medline, PsycINFO, Web of Science, and ProQuest databases to identify clinical trials of mental health apps. The risk of bias was assessed using the Cochrane Risk of Bias tool. Only 55 of 171 identified clinical trials reported AEs. AEs were more likely to be reported in trials sampling schizophrenia and delivering apps with symptom monitoring technology. The meta-analytic deterioration rate from 13 app conditions was 6.7% (95% CI = 4.3, 10.1, I = 75%). Deterioration rates did not differ between app and control groups (OR = 0.79, 95% CI = 0.62-1.01, I = 0%). Reporting of AEs was heterogeneous, in terms of assessments used, events recorded, and detail provided. Overall, few clinical trials of mental health apps report AEs. Those that do often provide insufficient information to properly judge risks related to app use.

References

Schlosser D, Campellone T, Truong B, Etter K, Vergani S, Komaiko K . Efficacy of PRIME, a Mobile App Intervention Designed to Improve Motivation in Young People With Schizophrenia. Schizophr Bull. 2018; 44(5):1010-1020. PMC: 6101497. DOI: 10.1093/schbul/sby078. View

Klatte R, Strauss B, Fluckiger C, Rosendahl J . Adverse events in psychotherapy randomized controlled trials: A systematic review. Psychother Res. 2023; 35(1):84-99. DOI: 10.1080/10503307.2023.2286992. View

Torous J, Bucci S, Bell I, Kessing L, Faurholt-Jepsen M, Whelan P . The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry. 2021; 20(3):318-335. PMC: 8429349. DOI: 10.1002/wps.20883. View

Zhao C, Zhao Z, Levin M, Lai L, Shi C, Hu J . Efficacy and acceptability of mobile application-delivered acceptance and commitment therapy for posttraumatic stress disorder in China: A randomized controlled trial. Behav Res Ther. 2023; 171:104440. DOI: 10.1016/j.brat.2023.104440. View

Garety P, Ward T, Emsley R, Greenwood K, Freeman D, Fowler D . Effects of SlowMo, a Blended Digital Therapy Targeting Reasoning, on Paranoia Among People With Psychosis: A Randomized Clinical Trial. JAMA Psychiatry. 2021; 78(7):714-725. PMC: 8027943. DOI: 10.1001/jamapsychiatry.2021.0326. View

Ponzo S, Morelli D, Kawadler J, Hemmings N, Bird G, Plans D . Efficacy of the Digital Therapeutic Mobile App BioBase to Reduce Stress and Improve Mental Well-Being Among University Students: Randomized Controlled Trial. JMIR Mhealth Uhealth. 2020; 8(4):e17767. PMC: 7171562. DOI: 10.2196/17767. View

Ly K, Truschel A, Jarl L, Magnusson S, Windahl T, Johansson R . Behavioural activation versus mindfulness-based guided self-help treatment administered through a smartphone application: a randomised controlled trial. BMJ Open. 2014; 4(1):e003440. PMC: 3902198. DOI: 10.1136/bmjopen-2013-003440. View

Goulding E, Dopke C, Rossom R, Jonathan G, Mohr D, Kwasny M . Effects of a Smartphone-Based Self-management Intervention for Individuals With Bipolar Disorder on Relapse, Symptom Burden, and Quality of Life: A Randomized Clinical Trial. JAMA Psychiatry. 2022; 80(2):109-118. PMC: 9857325. DOI: 10.1001/jamapsychiatry.2022.4304. View

Higgins J, Thompson S . Quantifying heterogeneity in a meta-analysis. Stat Med. 2002; 21(11):1539-58. DOI: 10.1002/sim.1186. View

10.

Greer J, Jacobs J, Pensak N, MacDonald J, Fuh C, Perez G . Randomized Trial of a Tailored Cognitive-Behavioral Therapy Mobile Application for Anxiety in Patients with Incurable Cancer. Oncologist. 2019; 24(8):1111-1120. PMC: 6693695. DOI: 10.1634/theoncologist.2018-0536. View

11.

McCue M, Blair C, Fehnert B, King J, Cormack F, Sarkey S . Mobile App to Enhance Patient Activation and Patient-Provider Communication in Major Depressive Disorder Management: Collaborative, Randomized Controlled Pilot Study. JMIR Form Res. 2022; 6(10):e34923. PMC: 9650572. DOI: 10.2196/34923. View

12.

Papaioannou D, Cooper C, Mooney C, Glover R, Coates E . Adverse event recording failed to reflect potential harms: a review of trial protocols of behavioral, lifestyle and psychological therapy interventions. J Clin Epidemiol. 2021; 136:64-76. DOI: 10.1016/j.jclinepi.2021.03.002. View

13.

Tonning M, Faurholt-Jepsen M, Frost M, Martiny K, Tuxen N, Rosenberg N . The effect of smartphone-based monitoring and treatment on the rate and duration of psychiatric readmission in patients with unipolar depressive disorder: The RADMIS randomized controlled trial. J Affect Disord. 2021; 282:354-363. DOI: 10.1016/j.jad.2020.12.141. View

14.

Moher D, Liberati A, Tetzlaff J, Altman D . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009; 151(4):264-9, W64. DOI: 10.7326/0003-4819-151-4-200908180-00135. View

15.

Ben-Zeev D, Brian R, Jonathan G, Razzano L, Pashka N, Carpenter-Song E . Mobile Health (mHealth) Versus Clinic-Based Group Intervention for People With Serious Mental Illness: A Randomized Controlled Trial. Psychiatr Serv. 2018; 69(9):978-985. DOI: 10.1176/appi.ps.201800063. View

16.

Bantjes J, Hunt X, Cuijpers P, Kazdin A, Kennedy C, Luedtke A . Comparative effectiveness of remote digital gamified and group CBT skills training interventions for anxiety and depression among college students: Results of a three-arm randomised controlled trial. Behav Res Ther. 2024; 178:104554. DOI: 10.1016/j.brat.2024.104554. View

17.

Linardon J, Shatte A, McClure Z, Fuller-Tyszkiewicz M . A broad focused digital intervention for recurrent binge eating: a randomized controlled non-inferiority trial. Psychol Med. 2022; 53(10):4580-4591. PMC: 10388300. DOI: 10.1017/S0033291722001477. View

18.

McLean C, Davis C, Miller M, Ruzek J, Neri E . The Effects of an Exposure-Based Mobile App on Symptoms of Posttraumatic Stress Disorder in Veterans: Pilot Randomized Controlled Trial. JMIR Mhealth Uhealth. 2022; 10(11):e38951. PMC: 9675013. DOI: 10.2196/38951. View

19.

Oh J, Jang S, Kim H, Kim J . Efficacy of mobile app-based interactive cognitive behavioral therapy using a chatbot for panic disorder. Int J Med Inform. 2020; 140:104171. DOI: 10.1016/j.ijmedinf.2020.104171. View

20.

Hantsoo L, Criniti S, Khan A, Moseley M, Kincler N, Faherty L . A Mobile Application for Monitoring and Management of Depressed Mood in a Vulnerable Pregnant Population. Psychiatr Serv. 2017; 69(1):104-107. PMC: 5750085. DOI: 10.1176/appi.ps.201600582. View