Real-World User Demographics of Three Web-Based Digital Mental Health Interventions Provided by the US Department of Veterans Affairs: Observational Study Using Web Analytics Data

Overview

Journal JMIR Form Res

Publisher JMIR Publications

Specialty Biomedical Engineering

Date 2023 Oct 18

PMID 37851501

Authors

Arthur T Ryan

Kelly A Stearns-Yoder

Lisa A Brenner

Affiliations

Soon will be listed here.

Abstract

Background: Unguided digital mental health interventions (UDMHIs) have the potential to provide low-cost and effective mental health care at scale. Controlled trials have demonstrated the efficacy of UDMHIs to address mental health symptoms and conditions. However, few previous publications have described the demographics of real-world users of UDMHIs that are freely available to the public. The US Department of Veterans Affairs has created and hosts several UDMHIs on its Veteran Training Portal website. These web-based, free-to-use, and publicly available UDMHIs include Path to Better Sleep, Anger and Irritability Management Skills, and Moving Forward, which focus on insomnia, problematic anger, and depression symptoms, respectively.

Objective: This study aimed to examine the user demographics of these 3 UDMHIs in the year 2021. In addition, it aimed to compare the age and gender distribution of the users of those 3 UDMHIs with one another and with the age and gender distribution of the total US veteran population.

Methods: Google Analytics was used to collect user data for each of the 3 UDMHIs. The age and gender distribution of the users of each UDMHI was compared with that of the other UDMHIs as well as with that of the overall US veteran population using chi-square tests. Information on the total number of users, the country they were in, and the devices they used to access the UDMHIs was also collected and reported.

Results: In 2021, the 3 UDMHIs together recorded 29,306 unique users. The estimated age range and gender were available for 24.12% (7068/29,306) of those users. Each UDMHI's age and gender distribution significantly differed from that of the other UDMHIs and from that of the overall US veteran population (P<.001 on all chi-square tests). Women and younger age groups were overrepresented among UDMHI users compared with the overall US veteran population. The majority of devices used to access the UDMHIs were desktop or laptop devices, although a substantial proportion of devices used were mobile devices (10,199/29,752, 34.28%). Most users (27,789/29,748, 93.41%) were located in the United States, with users from Canada, the United Kingdom, and Australia accounting for another 2.61% (775/29,748) of total users.

Conclusions: Our use of Google Analytics data provided useful information about the users of 3 free and publicly available UDMHIs provided by the US Department of Veterans Affairs. Although our findings should be considered in light of the limitations of autonomously collected web analytics data, they still offer useful information for health care policy makers, administrators, and UDMHI developers.

References

Mackintosh M, Morland L, Frueh B, Greene C, Rosen C . Peeking into the black box: mechanisms of action for anger management treatment. J Anxiety Disord. 2014; 28(7):687-95. DOI: 10.1016/j.janxdis.2014.07.001. View

Morland L, Greene C, Rosen C, Foy D, Reilly P, Shore J . Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial. J Clin Psychiatry. 2010; 71(7):855-63. DOI: 10.4088/JCP.09m05604blu. View

Ryan A, Brenner L, Ulmer C, Mackintosh M, Greene C . The Use of Evaluation Panels During the Development of a Digital Intervention for Veterans Based on Cognitive Behavioral Therapy for Insomnia: Qualitative Evaluation Study. JMIR Form Res. 2023; 7:e40104. PMC: 10028512. DOI: 10.2196/40104. View

Carpenter J, Crutchley P, Zilca R, Schwartz H, Smith L, Cobb A . Seeing the "Big" Picture: Big Data Methods for Exploring Relationships Between Usage, Language, and Outcome in Internet Intervention Data. J Med Internet Res. 2016; 18(8):e241. PMC: 5023946. DOI: 10.2196/jmir.5725. View

Andrews G, Basu A, Cuijpers P, Craske M, McEvoy P, English C . Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: An updated meta-analysis. J Anxiety Disord. 2018; 55:70-78. DOI: 10.1016/j.janxdis.2018.01.001. View

Harvey A, Gumport N . Evidence-based psychological treatments for mental disorders: modifiable barriers to access and possible solutions. Behav Res Ther. 2015; 68:1-12. PMC: 4395546. DOI: 10.1016/j.brat.2015.02.004. View

Bhattacharya A, Hopkins S, Sallis A, Budd E, Ashiru-Oredope D . A process evaluation of the UK-wide Antibiotic Guardian campaign: developing engagement on antimicrobial resistance. J Public Health (Oxf). 2016; 39(2):e40-e47. DOI: 10.1093/pubmed/fdw059. View

Grubbs K, Abraham T, Pyne J, Greene C, Teng E, Fortney J . Enhancing Problem-Solving Therapy With Smartphone Technology: A Pilot Randomized Controlled Trial. Psychiatr Serv. 2022; 73(7):805-808. DOI: 10.1176/appi.ps.201900254. View

Okuda M, Picazo J, Olfson M, Hasin D, Liu S, Bernardi S . Prevalence and correlates of anger in the community: results from a national survey. CNS Spectr. 2015; 20(2):130-9. PMC: 4384185. DOI: 10.1017/S1092852914000182. View

10.

Manber R, Carney C, Edinger J, Epstein D, Friedman L, Haynes P . Dissemination of CBTI to the non-sleep specialist: protocol development and training issues. J Clin Sleep Med. 2012; 8(2):209-18. PMC: 3311421. DOI: 10.5664/jcsm.1786. View

11.

Menzies R, OBrian S, Lowe R, Packman A, Onslow M . International Phase II clinical trial of CBTPsych: A standalone Internet social anxiety treatment for adults who stutter. J Fluency Disord. 2016; 48:35-43. DOI: 10.1016/j.jfludis.2016.06.002. View

12.

Possemato K, Wu J, Greene C, MacQueen R, Blonigen D, Wade M . Web-Based Problem-solving Training With and Without Peer Support in Veterans With Unmet Mental Health Needs: Pilot Study of Feasibility, User Acceptability, and Participant Engagement. J Med Internet Res. 2022; 24(1):e29559. PMC: 8796046. DOI: 10.2196/29559. View

13.

Kahlke F, Buntrock C, Smit F, Ebert D . Systematic review of economic evaluations for internet- and mobile-based interventions for mental health problems. NPJ Digit Med. 2022; 5(1):175. PMC: 9686241. DOI: 10.1038/s41746-022-00702-w. View

14.

Holmes N, van Agteren J, Dorstyn D . A systematic review of technology-assisted interventions for co-morbid depression and substance use. J Telemed Telecare. 2018; 25(3):131-141. DOI: 10.1177/1357633X17748991. View

15.

Trauer J, Qian M, Doyle J, Rajaratnam S, Cunnington D . Cognitive Behavioral Therapy for Chronic Insomnia: A Systematic Review and Meta-analysis. Ann Intern Med. 2015; 163(3):191-204. DOI: 10.7326/M14-2841. View

16.

Shafran R, Clark D, Fairburn C, Arntz A, Barlow D, Ehlers A . Mind the gap: Improving the dissemination of CBT. Behav Res Ther. 2009; 47(11):902-9. DOI: 10.1016/j.brat.2009.07.003. View

17.

Christensen H, Griffiths K, Korten A . Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res. 2002; 4(1):e3. PMC: 1761927. DOI: 10.2196/jmir.4.1.e3. View

18.

Al-Asadi A, Klein B, Meyer D . Posttreatment attrition and its predictors, attrition bias, and treatment efficacy of the anxiety online programs. J Med Internet Res. 2014; 16(10):e232. PMC: 4211028. DOI: 10.2196/jmir.3513. View

19.

Ulmer C, Bosworth H, Zervakis J, Goodwin K, Gentry P, Rose C . Provider-supported self-management cognitive behavioral therapy for insomnia (Tele-Self CBTi): Protocol for a randomized controlled trial. Contemp Clin Trials. 2022; 125:107060. DOI: 10.1016/j.cct.2022.107060. View

20.

Pauley D, Cuijpers P, Papola D, Miguel C, Karyotaki E . Two decades of digital interventions for anxiety disorders: a systematic review and meta-analysis of treatment effectiveness. Psychol Med. 2021; 53(2):567-579. PMC: 9899576. DOI: 10.1017/S0033291721001999. View