Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness
Overview
Affiliations
The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models..
Power and reproducibility in the external validation of brain-phenotype predictions.
Rosenblatt M, Tejavibulya L, Sun H, Camp C, Khaitova M, Adkinson B Nat Hum Behav. 2024; 8(10):2018-2033.
PMID: 39085406 DOI: 10.1038/s41562-024-01931-7.
Quillivic R, Gayraud F, Auxemery Y, Vanni L, Peschanski D, Eustache F Sci Rep. 2024; 14(1):12468.
PMID: 38816468 PMC: 11139884. DOI: 10.1038/s41598-024-61557-7.
An explainable machine learning model of cognitive decline derived from speech.
Chandler C, Diaz-Asper C, Turner R, Reynolds B, Elvevag B Alzheimers Dement (Amst). 2023; 15(4):e12516.
PMID: 38155915 PMC: 10752754. DOI: 10.1002/dad2.12516.
Power and reproducibility in the external validation of brain-phenotype predictions.
Rosenblatt M, Tejavibulya L, Camp C, Jiang R, Westwater M, Noble S bioRxiv. 2023; .
PMID: 37961654 PMC: 10634903. DOI: 10.1101/2023.10.25.563971.
Machine Learning and Pharmacogenomics at the Time of Precision Psychiatry.
Del Casale A, Sarli G, Bargagna P, Polidori L, Alcibiade A, Zoppi T Curr Neuropharmacol. 2023; 21(12):2395-2408.
PMID: 37559539 PMC: 10616924. DOI: 10.2174/1570159X21666230808170123.