Can Medical Algorithms Be Fair? Three Ethical Quandaries and One Dilemma

Overview

Journal BMJ Health Care Inform

Specialties Medical Informatics
Public Health

Date 2022 Apr 9

PMID 35396245

Authors

Kristine Baeroe

TOrbjorn Gundersen

Edmund Henden

Kjetil Rommetveit

Affiliations

Soon will be listed here.

Abstract

Objective: To demonstrate what it takes to reconcile the idea of fairness in medical algorithms and machine learning (ML) with the broader discourse of fairness and health equality in health research.

Method: The methodological approach used in this paper is theoretical and ethical analysis.

Result: We show that the question of ensuring comprehensive ML fairness is interrelated to three quandaries and one dilemma.

Discussion: As fairness in ML depends on a nexus of inherent justice and fairness concerns embedded in health research, a comprehensive conceptualisation is called for to make the notion useful.

Conclusion: This paper demonstrates that more analytical work is needed to conceptualise fairness in ML so it adequately reflects the complexity of justice and fairness concerns within the field of health research.

Citing Articles

Algorithmic individual fairness and healthcare: a scoping review.

Anderson J, Visweswaran S JAMIA Open. 2024; 8(1):ooae149.

PMID: 39737346 PMC: 11684587. DOI: 10.1093/jamiaopen/ooae149.

Knowledge and attitudes toward artificial intelligence in nursing among various categories of professionals in China: a cross-sectional study.

Wang X, Fei F, Wei J, Huang M, Xiang F, Tu J Front Public Health. 2024; 12:1433252.

PMID: 39015390 PMC: 11250283. DOI: 10.3389/fpubh.2024.1433252.

Health equity assessment of machine learning performance (HEAL): a framework and dermatology AI model case study.

Schaekermann M, Spitz T, Pyles M, Cole-Lewis H, Wulczyn E, Pfohl S EClinicalMedicine. 2024; 70:102479.

PMID: 38685924 PMC: 11056401. DOI: 10.1016/j.eclinm.2024.102479.

Algorithmic Individual Fairness and Healthcare: A Scoping Review.

Anderson J, Visweswaran S medRxiv. 2024; .

PMID: 38585746 PMC: 10996729. DOI: 10.1101/2024.03.25.24304853.

Fairness of artificial intelligence in healthcare: review and recommendations.

Ueda D, Kakinuma T, Fujita S, Kamagata K, Fushimi Y, Ito R Jpn J Radiol. 2023; 42(1):3-15.

PMID: 37540463 PMC: 10764412. DOI: 10.1007/s11604-023-01474-3.

References

Rajkomar A, Dean J, Kohane I . Machine Learning in Medicine. N Engl J Med. 2019; 380(14):1347-1358. DOI: 10.1056/NEJMra1814259. View

Rajkomar A, Hardt M, Howell M, Corrado G, Chin M . Ensuring Fairness in Machine Learning to Advance Health Equity. Ann Intern Med. 2018; 169(12):866-872. PMC: 6594166. DOI: 10.7326/M18-1990. View

Wester G, Baeroe K, Norheim O . Towards theoretically robust evidence on health equity: a systematic approach to contextualising equity-relevant randomised controlled trials. J Med Ethics. 2018; 45(1):54-59. DOI: 10.1136/medethics-2017-104610. View

Wawira Gichoya J, McCoy L, Celi L, Ghassemi M . Equity in essence: a call for operationalising fairness in machine learning for healthcare. BMJ Health Care Inform. 2021; 28(1). PMC: 8733939. DOI: 10.1136/bmjhci-2020-100289. View

Braveman P, Kumanyika S, Fielding J, LaVeist T, Borrell L, Manderscheid R . Health disparities and health equity: the issue is justice. Am J Public Health. 2011; 101 Suppl 1:S149-55. PMC: 3222512. DOI: 10.2105/AJPH.2010.300062. View

Peter F . Health equity and social justice. J Appl Philos. 2002; 18(2):159-70. DOI: 10.1111/1468-5930.00183. View

Benjamin R . Assessing risk, automating racism. Science. 2019; 366(6464):421-422. DOI: 10.1126/science.aaz3873. View

Sen A . Why health equity?. Health Econ. 2002; 11(8):659-66. DOI: 10.1002/hec.762. View

Baeroe K, Bringedal B . Just health: On the conditions for acceptable and unacceptable priority settings with respect to patients' socioeconomic status. J Med Ethics. 2011; 37(9):526-9. DOI: 10.1136/jme.2010.042085. View

10.

London A . Artificial Intelligence and Black-Box Medical Decisions: Accuracy versus Explainability. Hastings Cent Rep. 2019; 49(1):15-21. DOI: 10.1002/hast.973. View

11.

Levesque J, Harris M, Russell G . Patient-centred access to health care: conceptualising access at the interface of health systems and populations. Int J Equity Health. 2013; 12:18. PMC: 3610159. DOI: 10.1186/1475-9276-12-18. View

12.

Obermeyer Z, Powers B, Vogeli C, Mullainathan S . Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019; 366(6464):447-453. DOI: 10.1126/science.aax2342. View

13.

Desai R, Wang S, Vaduganathan M, Evers T, Schneeweiss S . Comparison of Machine Learning Methods With Traditional Models for Use of Administrative Claims With Electronic Medical Records to Predict Heart Failure Outcomes. JAMA Netw Open. 2020; 3(1):e1918962. PMC: 6991258. DOI: 10.1001/jamanetworkopen.2019.18962. View

14.

Marmot M, Friel S, Bell R, Houweling T, Taylor S . Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008; 372(9650):1661-9. DOI: 10.1016/S0140-6736(08)61690-6. View

15.

Topol E . High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019; 25(1):44-56. DOI: 10.1038/s41591-018-0300-7. View