Adapting to the Algorithm: How Accuracy Comparisons Promote the Use of a Decision Aid
Overview
Affiliations
In three experiments, we sought to understand when and why people use an algorithm decision aid. Distinct from recent approaches, we explicitly enumerate the algorithm's accuracy while also providing summary feedback and training that allowed participants to assess their own skills. Our results highlight that such direct performance comparisons between the algorithm and the individual encourages a strategy of selective reliance on the decision aid; individuals ignored the algorithm when the task was easier and relied on the algorithm when the task was harder. Our systematic investigation of summary feedback, training experience, and strategy hint manipulations shows that further opportunities to learn about the algorithm encourage not only increased reliance on the algorithm but also engagement in experimentation and verification of its recommendations. Together, our findings emphasize the decision-maker's capacity to learn about the algorithm providing insights for how we can improve the use of decision aids.
How human-AI feedback loops alter human perceptual, emotional and social judgements.
Glickman M, Sharot T Nat Hum Behav. 2024; 9(2):345-359.
PMID: 39695250 PMC: 11860214. DOI: 10.1038/s41562-024-02077-2.
When combinations of humans and AI are useful: A systematic review and meta-analysis.
Vaccaro M, Almaatouq A, Malone T Nat Hum Behav. 2024; 8(12):2293-2303.
PMID: 39468277 PMC: 11659167. DOI: 10.1038/s41562-024-02024-1.
Evaluation of the Impact of ChatGPT on the Selection of Surgical Technique in Bariatric Surgery.
Lopez-Gonzalez R, Sanchez-Cordero S, Pujol-Gebelli J, Castellvi J Obes Surg. 2024; 35(1):19-24.
PMID: 38760650 DOI: 10.1007/s11695-024-07279-1.
Assessment and management of chronic insomnia disorder: an algorithm for primary care physicians.
Selsick H, Heidbreder A, Ellis J, Ferini-Strambi L, Garcia-Borreguero D, Leontiou C BMC Prim Care. 2024; 25(1):138.
PMID: 38671358 PMC: 11055373. DOI: 10.1186/s12875-024-02381-w.
Three Challenges for AI-Assisted Decision-Making.
Steyvers M, Kumar A Perspect Psychol Sci. 2023; 19(5):722-734.
PMID: 37439761 PMC: 11373149. DOI: 10.1177/17456916231181102.