Why a reward you might get beats a reward you will get
Offered a certain small prize or a coin-flip for a slightly larger one, people work harder for the flip. Uncertainty itself adds value the payout does not.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Why can an uncertain reward of lower expected value produce more effort than a certain one?
Correct answer: B
Option A would predict regret on losing, not sustained effort, and the effect holds with known odds. Option C is ruled out because the uncertain reward’s expected value is equal or lower by design. The motivating-uncertainty effect works because reward anticipation peaks under uncertainty — the unresolved gamble is enjoyable in itself while the task is being done.
In one condition, finishing the task earns two dollars, guaranteed. In another, finishing earns either one dollar or two, decided by a coin the experimenter flips at the end. The expected value of the gamble is lower, yet the people offered the uncertain reward complete the task at a higher rate and report enjoying it more.
What everyone sees
Standard reasoning says a certain reward should dominate an uncertain one of equal or lower expected value — people are supposed to dislike risk, especially for gains. On that account the gamble should depress effort. It raises it. The uncertainty is not being tolerated despite its cost; under the right framing it is contributing value of its own, and the expected payout understates how motivating the offer is.
What is actually happening
Shen, Fishbach and Hsee reported what they named the motivating-uncertainty effect: across several experiments, people exerted more effort for an uncertain reward than for a certain one of equal or greater expected value — but only when they were focused on completing the task rather than deliberating over whether to start. Schultz, Dayan and Montague’s work on dopamine neurons supplies a mechanism at the neural level: reward-predicting signals respond most strongly to uncertainty, peaking when the probability of payoff is around one half, so the anticipation of an unresolved reward is itself experienced as rewarding.
Why it stays hidden
The effect hides because it reverses only inside the doing, not the choosing. Asked in advance which reward they would prefer, people pick the sure thing and mean it, so the standard intuition is confirmed at the moment anyone would test it. The extra pull of uncertainty appears only once the person is already engaged, where it is felt as fun or momentum rather than as a response to risk.
Anticipation, not receipt, is what the reward system pays out most for. A resolved prize has already spent that pleasure.
Anticipation, not receipt, is what the reward system pays out most for. A resolved prize has already spent that pleasure.
Collect this card
Anticipation, not receipt, is what the reward system pays out most for. A resolved prize has already spent that pleasure.
0 / 10,000 collected
Sources & further reading 2
- Shen, Fishbach & Hsee — the motivating-uncertainty effect: uncertainty produces more motivation
- Schultz, Dayan & Montague — a neural substrate of prediction and reward
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0435
The reason a graph without zero can double an effect
Truncating the y-axis does not change the data. It changes the slope the eye sees, and the eye reads slope as magnitude before the mind reads the numbers.
MasterThe hidden part #0435A graph with correct data and a truncated axis is not lying about the numbers. It is lying about the shape.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0460
The reason rationing changes what people want
A product that was adequate becomes desirable when restricted. The restriction changed the inference the buyer draws, not the product itself.
MasterThe hidden part #0460A quota does not just limit access. It changes the inference about what is being accessed. The product behind the restriction is perceived as the product that deserved the restriction.
Scarcity Open file -
Hidden Logic Entry #0010
Why “free” costs more than one cent
Dropping a price from one cent to zero does not shave one cent off the decision. It changes which part of the brain makes it.
MasterThe hidden part #0010Zero is not the smallest price. It is a different category of thing entirely.
Logic Open file -
No visual on fileRhetoric & Omission Entry #0585
The reason a statistic needs a comparison to mean anything
A number alone is a fact without a frame. The comparison supplied beside it is what gives it size, direction and significance.
MasterThe hidden part #0585A number alone is not an argument. The comparison beside it is the argument, and the person who chose the comparison chose the conclusion.
Rhetoric Open file
Annotations are reserved for archive members.
Sign in to annotate