Doomed to Repeat the Successes of the Past: History is Best Forgotten for Repeated Choices with Nonstationary Payoffs

Overview

Journal Mem Cognit

Specialty Psychology

Date 2009 Sep 12

PMID 19744938

Citations 9

Authors

Tim Rakow

Katherine Miler

Affiliations

Soon will be listed here.

Abstract

Many everyday tasks involve repeated choices in which past outcomes are used to estimate payoffs but in which present payoffs may differ from past ones. Two experiments with 10 decision problems employing the decisions-from-feedback paradigm examined the choice between two risky options, wherein the payoff probabilities for one option could change over a sequence of trials. Participants either saw the outcomes associated with each option, or additionally were given a "history" summarizing the outcomes of previous trials. Participants adapted quickly to new problems, but adapted slowly to payoff changes. Providing a history improved initial choices, but had a null or negative impact on later ones-although, appropriately, the summary received less weight in later trials. An associative choice model captured changes in preference, but not initial patterns of choice. The findings emphasize the adaptive value of forgetting in unstable decision environments, but illustrate how providing additional relevant information may hinder this.

Citing Articles

The importance of change communication and state motivation when adapting to changes.

Stasielowicz L Scand J Psychol. 2024; 66(1):59-75.

PMID: 39161126 PMC: 11735255. DOI: 10.1111/sjop.13066.

Testing the somatic marker hypothesis in decisions-from-experience with non-stationary outcome probabilities.

Wright R, Rakow T Front Psychol. 2023; 14:1195009.

PMID: 37575439 PMC: 10419193. DOI: 10.3389/fpsyg.2023.1195009.

Conformity and Group Performance.

Abofol T, Erev I, Sulitzeanu-Kenan R Hum Nat. 2023; 34(3):381-399.

PMID: 37541988 PMC: 10543786. DOI: 10.1007/s12110-023-09454-2.

Humans strategically avoid connecting to others who agree and avert the emergence of network polarization in a coordination task.

Gradwohl N, Strandburg-Peshkin A, Giese H Sci Rep. 2023; 13(1):11299.

PMID: 37438426 PMC: 10338681. DOI: 10.1038/s41598-023-38353-w.

Patterns of choice adaptation in dynamic risky environments.

Konstantinidis E, Harman J, Gonzalez C Mem Cognit. 2022; 50(4):864-881.

PMID: 35258779 PMC: 9018651. DOI: 10.3758/s13421-021-01244-4.

References

Kunadian B, Dunning J, Roberts A, Morley R, Twomey D, Hall J . Cumulative funnel plots for the early detection of interoperator variation: retrospective database analysis of observed versus predicted results of percutaneous coronary intervention. BMJ. 2008; 336(7650):931-4. PMC: 2335227. DOI: 10.1136/bmj.39512.529120.BE. View

Wolford G, Newman S, Miller M, Wig G . Searching for patterns in random sequences. Can J Exp Psychol. 2005; 58(4):221-8. DOI: 10.1037/h0087446. View

Schooler L, Hertwig R . How forgetting aids heuristic inference. Psychol Rev. 2005; 112(3):610-628. DOI: 10.1037/0033-295X.112.3.610. View

Newell B, Rakow T . The role of experience in decisions from description. Psychon Bull Rev. 2008; 14(6):1133-9. DOI: 10.3758/bf03193102. View

Gaissmaier W, Schooler L . The smart potential behind probability matching. Cognition. 2008; 109(3):416-22. DOI: 10.1016/j.cognition.2008.09.007. View

Katz L . EFFECTS OF DIFFERENTIAL MONETARY GAIN AND LOSS ON SEQUENTIAL TWO-CHOICE BEHAVIOR. J Exp Psychol. 1964; 68:245-9. DOI: 10.1037/h0044150. View

Erev I . On Learning To Become a Successful Loser: A Comparison of Alternative Abstractions of Learning Processes in the Loss Domain. J Math Psychol. 1998; 42(2/3):266-86. DOI: 10.1006/jmps.1998.1214. View

Gaissmaier W, Schooler L, Rieskamp J . Simple predictions fueled by capacity limitations: when are they successful?. J Exp Psychol Learn Mem Cogn. 2006; 32(5):966-82. DOI: 10.1037/0278-7393.32.5.966. View

de Leval M, Francois K, Bull C, Brawn W, Spiegelhalter D . Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. J Thorac Cardiovasc Surg. 1994; 107(3):914-23; discussion 923-4. View

10.

Yechiam E, Busemeyer J . Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychon Bull Rev. 2005; 12(3):387-402. DOI: 10.3758/bf03193783. View

11.

Biele G, Rieskamp J, Gonzalez R . Computational models for the combination of advice and individual learning. Cogn Sci. 2011; 33(2):206-42. DOI: 10.1111/j.1551-6709.2009.01010.x. View

12.

Jessup R, Bishara A, Busemeyer J . Feedback produces divergence from prospect theory in descriptive choice. Psychol Sci. 2008; 19(10):1015-22. DOI: 10.1111/j.1467-9280.2008.02193.x. View

13.

Ayton P, Fischer I . The hot hand fallacy and the gambler's fallacy: two faces of subjective randomness?. Mem Cognit. 2005; 32(8):1369-78. DOI: 10.3758/bf03206327. View

14.

Erev I, Barron G . On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychol Rev. 2005; 112(4):912-931. DOI: 10.1037/0033-295X.112.4.912. View

15.

Hertwig R, Barron G, Weber E, Erev I . Decisions from experience and the effect of rare events in risky choice. Psychol Sci. 2004; 15(8):534-9. DOI: 10.1111/j.0956-7976.2004.00715.x. View

16.

Gonzalez-Vallejo C . Making trade-offs: a probabilistic and context-sensitive model of choice behavior. Psychol Rev. 2002; 109(1):137-55. DOI: 10.1037/0033-295x.109.1.137. View

17.

Myers J, Sadler E . Effects of range of payoffs as a variable in risk taking. J Exp Psychol. 1960; 60:306-9. DOI: 10.1037/h0042499. View

18.

Busemeyer J, Townsend J . Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev. 1993; 100(3):432-59. DOI: 10.1037/0033-295x.100.3.432. View

19.

Fantino E, Esfandiari A . Probability matching: encouraging optimal responding in humans. Can J Exp Psychol. 2002; 56(1):58-63. DOI: 10.1037/h0087385. View

20.

Peterson C, ULEHLA Z . SEQUENTIAL PATTERNS AND MAXIMIZING. J Exp Psychol. 1965; 69:1-4. DOI: 10.1037/h0021597. View