» Articles » PMID: 32821855

Actionable Health App Evaluation: Translating Expert Frameworks into Objective Metrics

Overview
Journal NPJ Digit Med
Date 2020 Aug 22
PMID 32821855
Citations 49
Authors
Affiliations
Soon will be listed here.
Abstract

As use and availability of mobile health apps have increased, so too has the need for a thorough, accessible framework for app evaluation. The American Psychiatric Association's app evaluation model has emerged as a way to critically assess an app by considering accessibility, privacy and security, clinical foundation, engagement, and interoperability; however, there is no centralized database where users can view how various health apps perform when assessed via the APA model. In this perspective, we propose and outline our effort to translate the APA's model for the evaluation of health apps into a set of objective metrics that can be published online, making the framework actionable and accessible to a broad audience. The questions from the APA model were operationalized into 105 objective questions that are either binary or numeric. These questions serve as the foundation of an online database, where app evaluation consists of answering these 105 questions and can be crowdsourced. While the database has yet to be published and crowdsourced, initial internal testing demonstrated excellent interrater reliability. The database proposed here introduces a public and interactive approach to data collection that is guided by the APA model. The published product enables users to sort through the many mobile health apps and filter them according to individual preferences and priorities, making the ever-growing health app market more navigable.

Citing Articles

Technology use and interest in digital apps for mental health promotion and lifestyle intervention among young adults with serious mental illness.

Naslund J, Aschbrenner K J Affect Disord Rep. 2025; 6.

PMID: 40027518 PMC: 11870643. DOI: 10.1016/j.jadr.2021.100227.


Self-Management Support Apps for Spinal Cord Injury: Results of a Systematic Search in App Stores and Mobile App Rating Scale Evaluation.

Bernard R, Seijas V, Davis M, Volkova A, Diviani N, Luscher J JMIR Mhealth Uhealth. 2024; 12:e53677.

PMID: 39700493 PMC: 11695972. DOI: 10.2196/53677.


Assessing Digital Phenotyping for App Recommendations and Sustained Engagement: Cohort Study.

Dwyer B, Flathers M, Burns J, Mikkelson J, Perlmutter E, Chen K JMIR Form Res. 2024; 8:e62725.

PMID: 39560976 PMC: 11615540. DOI: 10.2196/62725.


Leveraging Personal Technologies in the Treatment of Schizophrenia Spectrum Disorders: Scoping Review.

DArcey J, Torous J, Asuncion T, Tackaberry-Giddens L, Zahid A, Ishak M JMIR Ment Health. 2024; 11:e57150.

PMID: 39348196 PMC: 11474131. DOI: 10.2196/57150.


Evaluation of Digital Mental Health Technologies in the United States: Systematic Literature Review and Framework Synthesis.

Catania J, Beaver S, Kamath R, Worthington E, Lu M, Gandhi H JMIR Ment Health. 2024; 11:e57401.

PMID: 39213023 PMC: 11399741. DOI: 10.2196/57401.


References
1.
Hendrikoff L, Kambeitz-Ilankovic L, Pryss R, Senner F, Falkai P, Pogarell O . Prospective acceptance of distinct mobile mental health features in psychiatric patients and mental health professionals. J Psychiatr Res. 2018; 109:126-132. DOI: 10.1016/j.jpsychires.2018.11.025. View

2.
Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S . The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. 2017; 16(3):287-298. PMC: 5608852. DOI: 10.1002/wps.20472. View

3.
Chan S, Li L, Torous J, Gratzer D, Yellowlees P . Review and Implementation of Self-Help and Automated Tools in Mental Health Care. Psychiatr Clin North Am. 2019; 42(4):597-609. DOI: 10.1016/j.psc.2019.07.001. View

4.
Fleming T, Merry S, Stasiak K, Hopkins S, Patolo T, Ruru S . The Importance of User Segmentation for Designing Digital Therapy for Adolescent Mental Health: Findings From Scoping Processes. JMIR Ment Health. 2019; 6(5):e12656. PMC: 6707580. DOI: 10.2196/12656. View

5.
Larsen M, Huckvale K, Nicholas J, Torous J, Birrell L, Li E . Using science to sell apps: Evaluation of mental health app store quality claims. NPJ Digit Med. 2019; 2:18. PMC: 6550255. DOI: 10.1038/s41746-019-0093-1. View