Validating a Novel Measure for Assessing Patient Openness and Concerns About Using Artificial Intelligence in Healthcare

Overview

Journal Learn Health Syst

Date 2025 Jan 17

PMID 39822920

Authors

Bryan A Sisk

Alison L Antes

Sunny C Lin

Paige Nong

James M DuBois

Affiliations

Soon will be listed here.

Abstract

Objectives: Patient engagement is critical for the effective development and use of artificial intelligence (AI)-enabled tools in learning health systems (LHSs). We adapted a previously validated measure from pediatrics to assess adults' openness and concerns about the use of AI in their healthcare.

Study Design: Cross-sectional survey.

Methods: We adapted the 33-item "Attitudes toward Artificial Intelligence in Healthcare for Parents" measure for administration to adults in the general US population (AAIH-A), recruiting participants through Amazon's Mechanical Turk (MTurk) crowdsourcing platform. AAIH-A assesses openness to AI-driven technologies and includes 7 subscales assessing participants' openness and concerns about these technologies. The openness scale includes examples of AI-driven tools for diagnosis, prediction, treatment selection, and medical guidance. Concern subscales assessed privacy, social justice, quality, human element of care, cost, shared decision-making, and convenience. We co-administered previously validated measures hypothesized to correlate with openness. We conducted a confirmatory factor analysis and assessed reliability and construct validity. We performed exploratory multivariable regression models to identify predictors of openness.

Results: A total of 379 participants completed the survey. Confirmatory factor analysis confirmed the seven dimensions of the concerns, and the scales had internal consistency reliability, and correlated as hypothesized with existing measures of trust and faith in technology. Multivariable models indicated that trust in technology and concerns about quality and convenience were significantly associated with openness.

Conclusions: The AAIH-A is a brief measure that can be used to assess adults' perspectives about AI-driven technologies in healthcare and LHSs. The use of AAIH-A can inform future development and implementation of AI-enabled tools for patient care in the LHS context that engage patients as key stakeholders.

Citing Articles

Validating a novel measure for assessing patient openness and concerns about using artificial intelligence in healthcare.

Sisk B, Antes A, Lin S, Nong P, DuBois J Learn Health Syst. 2025; 9(1):e10429.

PMID: 39822920 PMC: 11733432. DOI: 10.1002/lrh2.10429.

References

Hartz S, Quan T, Ibiebele A, Fisher S, Olfson E, Salyer P . The significant impact of education, poverty, and race on Internet-based research participant engagement. Genet Med. 2016; 19(2):240-243. PMC: 5274598. DOI: 10.1038/gim.2016.91. View

Aggarwal R, Farag S, Martin G, Ashrafian H, Darzi A . Patient Perceptions on Data Sharing and Applying Artificial Intelligence to Health Care Data: Cross-sectional Survey. J Med Internet Res. 2021; 23(8):e26162. PMC: 8430862. DOI: 10.2196/26162. View

Embi P, Richesson R, Tenenbaum J, Kannry J, Friedman C, Sarkar I . Reimagining the research-practice relationship: policy recommendations for informatics-enabled evidence-generation across the US health system. JAMIA Open. 2020; 2(1):2-9. PMC: 6951885. DOI: 10.1093/jamiaopen/ooy056. View

Rubin J, Silverstein J, Friedman C, Kush R, Anderson W, Lichter A . Transforming the future of health together: The Learning Health Systems Consensus Action Plan. Learn Health Syst. 2019; 2(3):e10055. PMC: 6508804. DOI: 10.1002/lrh2.10055. View

Friedman C, Rubin J, Brown J, Buntin M, Corn M, Etheredge L . Toward a science of learning systems: a research agenda for the high-functioning Learning Health System. J Am Med Inform Assoc. 2014; 22(1):43-50. PMC: 4433378. DOI: 10.1136/amiajnl-2014-002977. View

Antes A, Burrous S, Sisk B, Schuelke M, Keune J, DuBois J . Exploring perceptions of healthcare technologies enabled by artificial intelligence: an online, scenario-based survey. BMC Med Inform Decis Mak. 2021; 21(1):221. PMC: 8293482. DOI: 10.1186/s12911-021-01586-8. View

Sisk B, Antes A, Lin S, Nong P, DuBois J . Validating a novel measure for assessing patient openness and concerns about using artificial intelligence in healthcare. Learn Health Syst. 2025; 9(1):e10429. PMC: 11733432. DOI: 10.1002/lrh2.10429. View

Platt J, Jacobson P, Kardia S . Public Trust in Health Information Sharing: A Measure of System Trust. Health Serv Res. 2017; 53(2):824-845. PMC: 5867170. DOI: 10.1111/1475-6773.12654. View

Richardson J, Smith C, Curtis S, Watson S, Zhu X, Barry B . Patient apprehensions about the use of artificial intelligence in healthcare. NPJ Digit Med. 2021; 4(1):140. PMC: 8455556. DOI: 10.1038/s41746-021-00509-1. View

10.

DuBois J, Mozersky J, Antes A, English T, Parsons M, Baldwin K . Attitudes toward genomics and precision medicine. J Clin Transl Sci. 2021; 5(1):e120. PMC: 8278159. DOI: 10.1017/cts.2021.774. View

11.

Choudhury A, Shamszare H . Investigating the Impact of User Trust on the Adoption and Use of ChatGPT: Survey Analysis. J Med Internet Res. 2023; 25:e47184. PMC: 10337387. DOI: 10.2196/47184. View

12.

Buhrmester M, Kwang T, Gosling S . Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?. Perspect Psychol Sci. 2015; 6(1):3-5. DOI: 10.1177/1745691610393980. View

13.

Seroussi B, Fultz Hollis K, Soualmia L . Transparency of Health Informatics Processes as the Condition of Healthcare Professionals' and Patients' Trust and Adoption: the Rise of Ethical Requirements. Yearb Med Inform. 2020; 29(1):7-10. PMC: 7442515. DOI: 10.1055/s-0040-1702029. View

14.

Obermeyer Z, Powers B, Vogeli C, Mullainathan S . Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019; 366(6464):447-453. DOI: 10.1126/science.aax2342. View

15.

Platt J, Nong P . An Ecosystem Approach to Earning and Sustaining Trust in Health Care-Too Big to Care. JAMA Health Forum. 2023; 4(1):e224882. DOI: 10.1001/jamahealthforum.2022.4882. View

16.

Sisk B, Antes A, Burrous S, DuBois J . Parental Attitudes toward Artificial Intelligence-Driven Precision Medicine Technologies in Pediatric Healthcare. Children (Basel). 2020; 7(9). PMC: 7552627. DOI: 10.3390/children7090145. View

17.

. Patient trust must come at the top of researchers' priority list. Nat Med. 2020; 26(3):301. DOI: 10.1038/s41591-020-0813-8. View

18.

Panch T, Duralde E, Mattie H, Kotecha G, Celi L, Wright M . A distributed approach to the regulation of clinical AI. PLOS Digit Health. 2023; 1(5):e0000040. PMC: 9931237. DOI: 10.1371/journal.pdig.0000040. View

19.

Easterling D, Perry A, Woodside R, Patel T, Gesell S . Clarifying the concept of a learning health system for healthcare delivery organizations: Implications from a qualitative analysis of the scientific literature. Learn Health Syst. 2022; 6(2):e10287. PMC: 9006535. DOI: 10.1002/lrh2.10287. View

20.

Platt J, Raj M, Wienroth M . An Analysis of the Learning Health System in Its First Decade in Practice: Scoping Review. J Med Internet Res. 2020; 22(3):e17026. PMC: 7118548. DOI: 10.2196/17026. View