The Arabic Version of the Mobile App Rating Scale: Development and Validation Study

Overview

Journal JMIR Mhealth Uhealth

Specialties Biomedical Engineering
Medical Informatics

Date 2020 Mar 5

PMID 32130183

Citations 13

Authors

Marco Bardus

Nathalie Awada

Lilian A Ghandour

Elie-Jacques Fares

Tarek Gherbal

Tasnim Al-Zanati

Stoyan R Stoyanov

Affiliations

Soon will be listed here.

Abstract

Background: With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic.

Objective: This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders.

Methods: We followed a well-established and defined "universalist" process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps.

Results: MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (P<.001). The lowest correlation was observed in the area of usability (r=0.685), followed by aesthetics (r=0.827), information quality (r=0.854), engagement (r=0.894), and total app quality (r=0.897). Subjective quality was also highly correlated (r=0.820).

Conclusions: MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.

Citing Articles

A Systematic Assessment of the Quality of Smartphone Applications for Gastroesophageal Reflux Disease.

Gould M, Lin C, Walsh C Gastro Hep Adv. 2024; 2(5):733-742.

PMID: 39129878 PMC: 11308438. DOI: 10.1016/j.gastha.2023.03.001.

A Web-Based and Mobile Intervention Program Using a Spaced Education Approach for Workplace Mental Health Literacy: Cluster Randomized Controlled Trial.

Lam L, Lam M JMIR Ment Health. 2024; 11:e51791.

PMID: 38654570 PMC: 11063580. DOI: 10.2196/51791.

Utilization of patient portals: a cross-sectional study investigating associations with mobile app quality.

Yaman N, Zeitoun J, Diab R, Mdaihly M, Diab R, Kobeissi L BMC Med Inform Decis Mak. 2023; 23(1):177.

PMID: 37670277 PMC: 10481578. DOI: 10.1186/s12911-023-02252-x.

An Integrated Model for Evaluating the Sustainability of Gamified Mobile Health Apps: An Instrument Development and Validation.

Mustafa A, Ali N, Dhillon J, Sedera D Healthcare (Basel). 2023; 11(7).

PMID: 37046978 PMC: 10094640. DOI: 10.3390/healthcare11071051.

Greek validation of the user version of the Mobile Application Rating Scale (uMARS).

Chasiotis G, Stoyanov S, Karatzas A, Gravas S J Int Med Res. 2023; 51(3):3000605231161213.

PMID: 36924222 PMC: 10026115. DOI: 10.1177/03000605231161213.

References

Bindhim N, Hawkey A, Trevena L . A systematic review of quality assessment methods for smartphone health apps. Telemed J E Health. 2014; 21(2):97-104. DOI: 10.1089/tmj.2014.0088. View

Nikolaou C, Lean M . Mobile applications for obesity and weight management: current market characteristics. Int J Obes (Lond). 2016; 41(1):200-202. DOI: 10.1038/ijo.2016.186. View

Furlong L, Morris M, Erickson S, Serry T . Quality of Mobile Phone and Tablet Mobile Apps for Speech Sound Disorders: Protocol for an Evidence-Based Appraisal. JMIR Res Protoc. 2016; 5(4):e233. PMC: 5155082. DOI: 10.2196/resprot.6505. View

Domnich A, Arata L, Amicizia D, Signori A, Patrick B, Stoyanov S . Development and validation of the Italian version of the Mobile Application Rating Scale and its generalisability to apps targeting primary prevention. BMC Med Inform Decis Mak. 2016; 16:83. PMC: 4936279. DOI: 10.1186/s12911-016-0323-2. View

Rahim H, Sibai A, Khader Y, Hwalla N, Fadhil I, Alsiyabi H . Non-communicable diseases in the Arab world. Lancet. 2014; 383(9914):356-67. DOI: 10.1016/S0140-6736(13)62383-1. View

ONeill T . An Overview of Interrater Agreement on Likert Scales for Researchers and Practitioners. Front Psychol. 2017; 8:777. PMC: 5427087. DOI: 10.3389/fpsyg.2017.00777. View

Wilson H, Stoyanov S, Gandabhai S, Baldwin A . The Quality and Accuracy of Mobile Apps to Prevent Driving After Drinking Alcohol. JMIR Mhealth Uhealth. 2016; 4(3):e98. PMC: 4993865. DOI: 10.2196/mhealth.5961. View

Musaiger A, Al-Mannai M, Al-Lalla O, Saghir S, Halahleh I, Benhamed M . Obesity among adolescents in five Arab countries; relative to gender and age. Nutr Hosp. 2014; 28(6):1922-5. DOI: 10.3305/nutr hosp.v28in06.6412. View

Schippers M, Adam P, Smolenski D, Wong H, de Wit J . A meta-analysis of overall effects of weight loss interventions delivered via mobile phones and effect size differences according to delivery mode, personal contact, and intervention intensity and duration. Obes Rev. 2017; 18(4):450-459. DOI: 10.1111/obr.12492. View

10.

Musaiger A . Overweight and obesity in eastern mediterranean region: prevalence and possible causes. J Obes. 2011; 2011:407237. PMC: 3175401. DOI: 10.1155/2011/407237. View

11.

Bardus M, Smith J, Samaha L, Abraham C . Mobile and Web 2.0 interventions for weight management: an overview of review evidence and its methodological quality. Eur J Public Health. 2016; 26(4):602-10. PMC: 5885948. DOI: 10.1093/eurpub/ckw090. View

12.

The Lancet . Does mobile health matter?. Lancet. 2017; 390(10109):2216. DOI: 10.1016/S0140-6736(17)32899-4. View

13.

Stoyanov S, Hides L, Kavanagh D, Zelenko O, Tjondronegoro D, Mani M . Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015; 3(1):e27. PMC: 4376132. DOI: 10.2196/mhealth.3422. View

14.

Herdman M, Fox-Rushby J, Badia X . A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998; 7(4):323-35. DOI: 10.1023/a:1024985930536. View

15.

Royston G, Hagar C, Long L, McMahon D, Pakenham-Walsh N, Wadhwani N . Mobile health-care information for all: a global challenge. Lancet Glob Health. 2015; 3(7):e356-7. DOI: 10.1016/S2214-109X(15)00054-6. View

16.

Azar K, Lesser L, Laing B, Stephens J, Aurora M, Burke L . Mobile applications for weight management: theory-based content analysis. Am J Prev Med. 2013; 45(5):583-9. DOI: 10.1016/j.amepre.2013.07.005. View

17.

Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D . Evidence-based strategies in weight-loss mobile apps. Am J Prev Med. 2013; 45(5):576-82. DOI: 10.1016/j.amepre.2013.04.025. View

18.

Bardus M, van Beurden S, Smith J, Abraham C . A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act. 2016; 13:35. PMC: 4785735. DOI: 10.1186/s12966-016-0359-9. View

19.

Larsen M, Nicholas J, Christensen H . Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps. JMIR Mhealth Uhealth. 2016; 4(3):e96. PMC: 4995352. DOI: 10.2196/mhealth.6020. View

20.

Epstein J, Santo R, Guillemin F . A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015; 68(4):435-41. DOI: 10.1016/j.jclinepi.2014.11.021. View