» Articles » PMID: 31304401

Do You Understand the Words That Are Comin Outta My Mouth? Voice Assistant Comprehension of Medication Names

Overview
Journal NPJ Digit Med
Date 2019 Jul 16
PMID 31304401
Citations 17
Authors
Affiliations
Soon will be listed here.
Abstract

This study investigated the speech recognition abilities of popular voice assistants when being verbally asked about commonly dispensed medications by a variety of participants. Voice recordings of 46 participants (12 of which had a foreign accent in English) were played back to Amazon's Alexa, Google Assistant, and Apple's Siri for the brand- and generic names of the top 50 most dispensed medications in the United States. A repeated measures ANOVA indicated that Google Assistant achieved the highest comprehension accuracy for both brand medication names ( = 91.8%, SD = 4.2) and generic medication names ( = 84.3%, SD = 11.2), followed by Siri (brand names  = 58.5%, SD = 11.2; generic names  = 51.2%, SD = 16.0), and the lowest accuracy by Alexa (brand names  = 54.6%, SD = 10.8; generic names  = 45.5%, SD = 15.4). An interaction between voice assistant and participant accent was also found, demonstrating lower comprehension performance overall for those with a foreign accent using Siri ( = 48.8%, SD = 11.8) and Alexa ( = 41.7%, SD = 12.7), compared to participants without a foreign accent (Siri  = 57.0%, SD = 11.7; Alexa  = 53.0%, SD = 10.9). No significant difference between participant accents were found for Google Assistant. These findings show a substantial performance lead for Google Assistant compared to its voice assistant competitors when comprehending medication names, but there is still room for improvement.

Citing Articles

Redefining Virtual Assistants in Health Care: The Future With Large Language Models.

Sezgin E J Med Internet Res. 2024; 26:e53225.

PMID: 38241074 PMC: 10837753. DOI: 10.2196/53225.


Association Between User Interaction and Treatment Response of a Voice-Based Coach for Treating Depression and Anxiety: Secondary Analysis of a Pilot Randomized Controlled Trial.

Lv N, Kannampallil T, Xiao L, Ronneberg C, Kumar V, Wittels N JMIR Hum Factors. 2023; 10:e49715.

PMID: 37930781 PMC: 10660207. DOI: 10.2196/49715.


Automated Diet Capture Using Voice Alerts and Speech Recognition on Smartphones: Pilot Usability and Acceptability Study.

Chikwetu L, Daily S, Mortazavi B, Dunn J JMIR Form Res. 2023; 7:e46659.

PMID: 37191989 PMC: 10230351. DOI: 10.2196/46659.


Effects of a virtual voice-based coach delivering problem-solving treatment on emotional distress and brain function: a pilot RCT in depression and anxiety.

Kannampallil T, Ajilore O, Lv N, Smyth J, Wittels N, Ronneberg C Transl Psychiatry. 2023; 13(1):166.

PMID: 37173334 PMC: 10175049. DOI: 10.1038/s41398-023-02462-x.


Design and Formative Evaluation of a Virtual Voice-Based Coach for Problem-solving Treatment: Observational Study.

Kannampallil T, Ronneberg C, Wittels N, Kumar V, Lv N, Smyth J JMIR Form Res. 2022; 6(8):e38092.

PMID: 35969431 PMC: 9419044. DOI: 10.2196/38092.


References
1.
Miner A, Milstein A, Schueller S, Hegde R, Mangurian C, Linos E . Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health. JAMA Intern Med. 2016; 176(5):619-25. PMC: 4996669. DOI: 10.1001/jamainternmed.2016.0400. View

2.
Ho D . Voice-controlled virtual assistants for the older people with visual impairment. Eye (Lond). 2017; 32(1):53-54. PMC: 5770711. DOI: 10.1038/eye.2017.165. View

3.
Hoy M . Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Med Ref Serv Q. 2018; 37(1):81-88. DOI: 10.1080/02763869.2018.1404391. View

4.
Boyd M, Wilson N . Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice. PLoS One. 2018; 13(3):e0194811. PMC: 5874038. DOI: 10.1371/journal.pone.0194811. View

5.
Fuentes A, Pineda M, Nagulapalli Venkata K . Comprehension of Top 200 Prescribed Drugs in the US as a Resource for Pharmacy Teaching, Training and Practice. Pharmacy (Basel). 2018; 6(2). PMC: 6025009. DOI: 10.3390/pharmacy6020043. View