» Articles » PMID: 35133521

Adapting to the Algorithm: How Accuracy Comparisons Promote the Use of a Decision Aid

Overview
Specialty Psychology
Date 2022 Feb 8
PMID 35133521
Authors
Affiliations
Soon will be listed here.
Abstract

In three experiments, we sought to understand when and why people use an algorithm decision aid. Distinct from recent approaches, we explicitly enumerate the algorithm's accuracy while also providing summary feedback and training that allowed participants to assess their own skills. Our results highlight that such direct performance comparisons between the algorithm and the individual encourages a strategy of selective reliance on the decision aid; individuals ignored the algorithm when the task was easier and relied on the algorithm when the task was harder. Our systematic investigation of summary feedback, training experience, and strategy hint manipulations shows that further opportunities to learn about the algorithm encourage not only increased reliance on the algorithm but also engagement in experimentation and verification of its recommendations. Together, our findings emphasize the decision-maker's capacity to learn about the algorithm providing insights for how we can improve the use of decision aids.

Citing Articles

How human-AI feedback loops alter human perceptual, emotional and social judgements.

Glickman M, Sharot T Nat Hum Behav. 2024; 9(2):345-359.

PMID: 39695250 PMC: 11860214. DOI: 10.1038/s41562-024-02077-2.


When combinations of humans and AI are useful: A systematic review and meta-analysis.

Vaccaro M, Almaatouq A, Malone T Nat Hum Behav. 2024; 8(12):2293-2303.

PMID: 39468277 PMC: 11659167. DOI: 10.1038/s41562-024-02024-1.


Evaluation of the Impact of ChatGPT on the Selection of Surgical Technique in Bariatric Surgery.

Lopez-Gonzalez R, Sanchez-Cordero S, Pujol-Gebelli J, Castellvi J Obes Surg. 2024; 35(1):19-24.

PMID: 38760650 DOI: 10.1007/s11695-024-07279-1.


Assessment and management of chronic insomnia disorder: an algorithm for primary care physicians.

Selsick H, Heidbreder A, Ellis J, Ferini-Strambi L, Garcia-Borreguero D, Leontiou C BMC Prim Care. 2024; 25(1):138.

PMID: 38671358 PMC: 11055373. DOI: 10.1186/s12875-024-02381-w.


Three Challenges for AI-Assisted Decision-Making.

Steyvers M, Kumar A Perspect Psychol Sci. 2023; 19(5):722-734.

PMID: 37439761 PMC: 11373149. DOI: 10.1177/17456916231181102.

References
1.
Shaffer V, Probst C, Merkle E, Arkes H, Medow M . Why do patients derogate physicians who use a computer-based diagnostic support system?. Med Decis Making. 2012; 33(1):108-18. DOI: 10.1177/0272989X12453501. View

2.
Giguere G, Love B . Limits in decision making arise from limits in memory retrieval. Proc Natl Acad Sci U S A. 2013; 110(19):7613-8. PMC: 3651451. DOI: 10.1073/pnas.1219674110. View

3.
Bartlett M, McCarley J . No Effect of Cue Format on Automation Dependence in an Aided Signal Detection Task. Hum Factors. 2018; 61(2):169-190. DOI: 10.1177/0018720818802961. View

4.
Koehler D, James G . Probability matching and strategy availability. Mem Cognit. 2010; 38(6):667-76. DOI: 10.3758/MC.38.6.667. View

5.
Bigman Y, Gray K . People are averse to machines making moral decisions. Cognition. 2018; 181:21-34. DOI: 10.1016/j.cognition.2018.08.003. View