» Articles » PMID: 16812184

Choice Between Rewards Differing in Amount and Delay: Toward a Choice Model of Self Control

Overview
Date 1980 Sep 1
PMID 16812184
Citations 38
Authors
Affiliations
Soon will be listed here.
Abstract

A concurrent-chain procedure was used to study pigeons' choices between rewards differing in both amount and delay. The shorter delay terminated with a 2-second access to grain whereas the longer delay terminated with a 6-second access to grain. The ratio of the delays was constant within a given condition while their absolute values were varied. Over conditions, ratios of 6:1, 3:1, and 3:2 were studied. As the absolute values of the delays to reinforcement increased, preference for the longer-delayed but larger reward decreased under both the 6:1 and 3:1 ratios, but increased under the 3:2 ratio. These results are inconsistent with choice models predicting no change in preference when the ratios of delays and amounts are held constant. In addition, the change in preference under the 3:1 ratio is inconsistent with a simple multiplicative interaction of the trade off between reinforcer amount and delay, and suggests that delay is a more potent determinant of choice than is amount. These results have implications for models that view choice between small immediate rewards and large but delayed rewards as underlying the behavior commonly called self control.

Citing Articles

The effects of physical activity on impulsive choice: Influence of sensitivity to reinforcement amount and delay.

Strickland J, Feinstein M, Lacy R, Smith M Behav Processes. 2016; 126:36-45.

PMID: 26964905 PMC: 4826829. DOI: 10.1016/j.beproc.2016.03.002.


Lithium, but not valproate, reduces impulsive choice in the delay-discounting task in mice.

Halcomb M, Gould T, Grahame N Neuropsychopharmacology. 2013; 38(10):1937-44.

PMID: 23584261 PMC: 3746699. DOI: 10.1038/npp.2013.89.


Pigeons' choices with token stimuli in concurrent variable-interval schedules.

Mazur J, Biondi D J Exp Anal Behav. 2013; 99(2):159-78.

PMID: 23460072 PMC: 3896056. DOI: 10.1002/jeab.12.


Reinforcer accumulation in a token-reinforcement context with pigeons.

Yankelevitz R, Bullock C, Hackenberg T J Exp Anal Behav. 2008; 90(3):283-99.

PMID: 19070337 PMC: 2582204. DOI: 10.1901/jeab.2008.90-283.


A model of reward choice based on the theory of reinforcement learning.

Smirnitskaya I, Frolov A, Merzhanova G Neurosci Behav Physiol. 2008; 38(3):269-78.

PMID: 18264774 DOI: 10.1007/s11055-008-0039-6.


References
1.
Neuringer A . Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav. 1967; 10(5):417-24. PMC: 1338405. DOI: 10.1901/jeab.1967.10-417. View

2.
Fantino E . Choice and rate of reinforcement. J Exp Anal Behav. 1969; 12(5):723-30. PMC: 1338674. DOI: 10.1901/jeab.1969.12-723. View

3.
FLESHLER M, Hoffman H . A progression for generating variable-interval schedules. J Exp Anal Behav. 1962; 5:529-30. PMC: 1404199. DOI: 10.1901/jeab.1962.5-529. View

4.
Catania A . Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963; 6:299-300. PMC: 1404290. DOI: 10.1901/jeab.1963.6-299. View

5.
Herrnstein R . APERIODICITY AS A FACTOR IN CHOICE. J Exp Anal Behav. 1964; 7:179-82. PMC: 1404317. DOI: 10.1901/jeab.1964.7-179. View