Algorithmic Individual Fairness and Healthcare: a Scoping Review

Overview

Journal JAMIA Open

Date 2024 Dec 31

PMID 39737346

Authors

Joshua W Anderson

Shyam Visweswaran

Affiliations

Soon will be listed here.

Abstract

Objectives: Statistical and artificial intelligence algorithms are increasingly being developed for use in healthcare. These algorithms may reflect biases that magnify disparities in clinical care, and there is a growing need for understanding how algorithmic biases can be mitigated in pursuit of algorithmic fairness. We conducted a scoping review on algorithmic individual fairness (IF) to understand the current state of research in the metrics and methods developed to achieve IF and their applications in healthcare.

Materials And Methods: We searched four databases: PubMed, ACM Digital Library, IEEE Xplore, and medRxiv for algorithmic IF metrics, algorithmic bias mitigation, and healthcare applications. Our search was restricted to articles published between January 2013 and November 2024. We identified 2498 articles through database searches and seven additional articles, of which 32 articles were included in the review. Data from the selected articles were extracted, and the findings were synthesized.

Results: Based on the 32 articles in the review, we identified several themes, including philosophical underpinnings of fairness, IF metrics, mitigation methods for achieving IF, implications of achieving IF on group fairness and vice versa, and applications of IF in healthcare.

Discussion: We find that research of IF is still in their early stages, particularly in healthcare, as evidenced by the limited number of relevant articles published between 2013 and 2024. While healthcare applications of IF remain sparse, growth has been steady in number of publications since 2012. The limitations of group fairness further emphasize the need for alternative approaches like IF. However, IF itself is not without challenges, including subjective definitions of similarity and potential bias encoding from data-driven methods. These findings, coupled with the limitations of the review process, underscore the need for more comprehensive research on the evolution of IF metrics and definitions to advance this promising field.

Conclusion: While significant work has been done on algorithmic IF in recent years, the definition, use, and study of IF remain in their infancy, especially in healthcare. Future research is needed to comprehensively apply and evaluate IF in healthcare.

References

Johnson A, Cooper G, Visweswaran S . Patient-Specific Modeling with Personalized Decision Paths. AMIA Annu Symp Proc. 2021; 2020:602-611. PMC: 8075540. View

Adamson A, Smith A . Machine Learning and Health Care Disparities in Dermatology. JAMA Dermatol. 2018; 154(11):1247-1248. DOI: 10.1001/jamadermatol.2018.2348. View

Jun I, Ser S, Cohen S, Xu J, Lucero R, Bian J . Quantifying Health Outcome Disparity in Invasive Methicillin-Resistant Staphylococcus aureus Infection using Fairness Algorithms on Real-World Data. Pac Symp Biocomput. 2023; 29:419-432. PMC: 10795837. View

Ueda D, Kakinuma T, Fujita S, Kamagata K, Fushimi Y, Ito R . Fairness of artificial intelligence in healthcare: review and recommendations. Jpn J Radiol. 2023; 42(1):3-15. PMC: 10764412. DOI: 10.1007/s11604-023-01474-3. View

Zech J, Badgeley M, Liu M, Costa A, Titano J, Oermann E . Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study. PLoS Med. 2018; 15(11):e1002683. PMC: 6219764. DOI: 10.1371/journal.pmed.1002683. View

Zhou R, Liu Y, Xia W, Guo Y, Huang Z, Gan H . JoCoRank: Joint correlation learning with ranking similarity regularization for imbalanced fetal brain age regression. Comput Biol Med. 2024; 171:108111. DOI: 10.1016/j.compbiomed.2024.108111. View

Gaube S, Suresh H, Raue M, Merritt A, Berkowitz S, Lermer E . Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ Digit Med. 2021; 4(1):31. PMC: 7896064. DOI: 10.1038/s41746-021-00385-9. View

Visweswaran S, Ferreira A, Ribeiro G, Oliveira A, Cooper G . Personalized Modeling for Prediction with Decision-Path Models. PLoS One. 2015; 10(6):e0131022. PMC: 4476684. DOI: 10.1371/journal.pone.0131022. View

Vyas D, Eisenstein L, Jones D . Hidden in Plain Sight - Reconsidering the Use of Race Correction in Clinical Algorithms. N Engl J Med. 2020; 383(9):874-882. DOI: 10.1056/NEJMms2004740. View

10.

Baeroe K, Gundersen T, Henden E, Rommetveit K . Can medical algorithms be fair? Three ethical quandaries and one dilemma. BMJ Health Care Inform. 2022; 29(1). PMC: 8996015. DOI: 10.1136/bmjhci-2021-100445. View

11.

Obermeyer Z, Powers B, Vogeli C, Mullainathan S . Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019; 366(6464):447-453. DOI: 10.1126/science.aax2342. View

12.

Rajkomar A, Hardt M, Howell M, Corrado G, Chin M . Ensuring Fairness in Machine Learning to Advance Health Equity. Ann Intern Med. 2018; 169(12):866-872. PMC: 6594166. DOI: 10.7326/M18-1990. View

13.

Visweswaran S, Angus D, Hsieh M, Weissfeld L, Yealy D, Cooper G . Learning patient-specific predictive models from clinical data. J Biomed Inform. 2010; 43(5):669-85. PMC: 2933959. DOI: 10.1016/j.jbi.2010.04.009. View

14.

Fiscella K, Williams D . Health disparities based on socioeconomic inequities: implications for urban health care. Acad Med. 2004; 79(12):1139-47. DOI: 10.1097/00001888-200412000-00004. View

15.

Anderson M, Anderson S . How Should AI Be Developed, Validated, and Implemented in Patient Care?. AMA J Ethics. 2019; 21(2):E125-130. DOI: 10.1001/amajethics.2019.125. View

16.

. World Medical Association Declaration of Geneva. Afr Health Sci. 2018; 17(4):1203. PMC: 5870282. DOI: 10.4314/ahs.v17i4.30. View

17.

Getzen E, Ungar L, Mowery D, Jiang X, Long Q . Mining for equitable health: Assessing the impact of missing data in electronic health records. J Biomed Inform. 2023; 139:104269. PMC: 10391553. DOI: 10.1016/j.jbi.2022.104269. View

18.

Schulman K, Berlin J, Harless W, Kerner J, Sistrunk S, Gersh B . The effect of race and sex on physicians' recommendations for cardiac catheterization. N Engl J Med. 1999; 340(8):618-26. DOI: 10.1056/NEJM199902253400806. View

19.

Tricco A, Lillie E, Zarin W, OBrien K, Colquhoun H, Levac D . PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018; 169(7):467-473. DOI: 10.7326/M18-0850. View

20.

Konkel L . Racial and Ethnic Disparities in Research Studies: The Challenge of Creating More Diverse Cohorts. Environ Health Perspect. 2015; 123(12):A297-302. PMC: 4670264. DOI: 10.1289/ehp.123-A297. View