The Effect of Foregone Outcomes on Choices From Experience
An Individual-Level Modeling Analysis
Abstract
We examined the relative weight given to obtained and foregone outcomes (i.e., outcomes from the non-chosen options) in repeated choices using cognitive modeling. Previous modeling studies have yielded mixed results. When participants’ choices are analyzed by models that predict the next choice ahead in a sequence of decisions, the results imply that people give less weight to foregone than to obtained outcomes. In contrast, in simulation models of n trials ahead, the results imply that, on average, people give equal weight to foregone and obtained outcomes. Using datasets of experience-based binary choices with fixed (stationary) payoff distributions (Erev & Haruvy, in press) and dynamic (nonstationary) payoff distributions (Rakow & Miler, 2009), we employed generalization tests at the individual level to examine whether the findings derived from the one-step-ahead method are due to overfitting. The results of trial-ahead model fitting implied that for the nonstationary tasks only, foregone outcomes received lower weight. However, when this dataset was assessed via generalization criteria at the individual level, equal weighting of foregone and obtained outcomes was the best assumption. This implies that overfitting is implicated in the superior fit of models that assume discounting of foregone outcomes.
References
(2008). Comparison of decision learning models using the generalization criterion method. Cognitive Science, 32, 1376–1402.
(2009). The coexistence of overestimation and underweighting of rare events and the contingent recency effect. Judgment and Decision Making, 4, 447–460.
(1992). An adaptive approach to human decision-making: Learning theory, decision theory, and human performance. Journal of Experimental Psychology: General, 121, 177–194.
(2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychological Assessment, 14, 253–262.
(2000). Model comparisons and model selections based on generalization criterion methodology. Journal of Mathematical Psychology, 44, 171–189.
(1999). Experience-weighted attraction learning in normal form games. Econometrica, 67, 827–874.
(2011). When and why rare events are underweighted: A direct comparison of the sampling, partial feedback, full feedback and description choice paradigms. Psychonomic Bulletin and Review, 18, 377–384. doi: 10.3758/s13423-010-0040-2.
(2005). On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychological Review, 112, 912–931.
(2008). Loss aversion, diminishing sensitivity, and the effect of experience on repeated decisions. Journal of Behavioral Decision Making, 21, 575–597.
(2005). Generality, repetition, and the role of descriptive learning models. Journal of Mathematical Psychology, 49, 357–371.
(
in press ). Learning and the economics of small decisions. In , The handbook of experimental economics (Vol. 2). Princeton, NJ: Princeton University Press.(2007). Replicated alternatives and the role of confusion, chasing, and regret in decisions from experience. Journal of Behavioral Decision Making, 20, 305–322.
(1956). The problem of inference from curves based on group data. Psychological Bulletin, 53, 134–140.
(2000). Reinforcement-based vs. beliefs-based learning in experimental asymmetric-information games. Econometrica, 68, 605–641.
(1995). Consistency and cautious fictitious play. Journal of Economic Dynamics & Control, 19, 1065–1089.
(2006). Foregone with the wind: Indirect payoff information and its implications for choice. International Journal of Game Theory, 34, 285–302.
(1998). Food choice in rats (Rattus norvegicus): The effect of exposure to a poisoned conspecific. Japanese Psychological Research, 50, 172–177.
(1959). Individual choice behavior. New York: Wiley.
(2004). Economic learning, experiments and the limits to information. Cheltenham, UK: Edward Elgar Publishing.
(2001). Explaining social learning of food preferences without aversions: An evolutionary simulation model of Norway rats. Proceedings of the Royal Society of London. Series B, Biological Sciences, 268, 141–149.
(2009). Doomed to repeat the successes of the past: History is best forgotten for repeated choices with non-stationary payoffs. Memory and Cognition, 37, 985–1000.
(2010). Degrees of uncertainty: An overview and framework for future research on experience-based choice. Journal of Behavioral Decision Making, 23, 1–14.
(2007). Rules-plus-exception tasks: A problem for exemplar models?. Psychonomic Bulletin & Review, 14, 640–646.
(1999). Payoff assessments without probabilities: A simple dynamic model of choice. Games and Economic Behavior, 28, 294–309.
(1978). Estimating the dimension of a model. The Annals of Statistics, 5, 461–464.
(1997). A neural substrate of prediction and reward. Science, 14, 1593–1599.
(1987). The perils of averaging data over strategies: An example from children’s addition. Journal of Experimental Psychology: General, 116, 250–264.
(2008). Ratio and difference comparisons of expected reward in decision making tasks. Memory & Cognition, 36, 1460–1469.
(2005). Comparison of basic assumptions embedded in learning models for experience based decision-making. Psychonomic Bulletin & Review, 12, 387–402.
(2006). The effect of foregone payoffs on underweighting small probability events. Journal of Behavioral Decision Making, 19, 1–16.
(2008). Evaluating generalizability and parameter consistency in learning models. Games and Economic Behavior, 63, 370–394.
(2008). Observing others’ behavior and risk taking in decisions from experience. Judgment and Decision Making, 3, 493–500.
(2007). Evaluating the reliance on past choices in adaptive learning models. Journal of Mathematical Psychology, 51, 75–84.
(1999). Anticipated regret, expected feedback and behavioral decision making. Journal of Behavioral Decision Making, 12, 93–106.
(2004). Consequences of regret aversion in real life: The case of the Dutch postcode lottery. Organizational Behavior and Human Decision Processes, 93, 155–168.
