The reason a prediction can cause its own failure
The forecast changed the system it was forecasting. The prediction was accurate about the world before it was announced, and inaccurate about the world after.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
A forecast of overcrowding empties a bridge. Why was the forecast wrong?
Correct answer: B
Merton described the self-defeating prophecy and Grunberg and Modigliani formalised it. The model was not inaccurate about the original system; the announcement created a new system that the model had not described.
A credible forecast says a bridge will be overcrowded on Saturday. Drivers hear the forecast and take an alternative route. The bridge is empty on Saturday. The forecast was wrong, and it was wrong because it was believed by the very people whose behaviour it was trying to predict.
What everyone sees
The wrong forecast is filed as a forecasting error: the model overestimated demand, and next time it should be adjusted downward. The possibility that the forecast itself was the cause of the undershoot is not standard in the debrief, because forecasts are assumed to observe a system rather than to participate in it.
What is actually happening
Merton described the self-defeating prophecy (the inverse of his more famous self-fulfilling prophecy): a prediction that provokes action which prevents the predicted outcome. Grunberg and Modigliani formalised the problem: if a forecast enters the decision set of the agents it describes, the system is no longer the same system the forecast was made about. Simon showed that public predictions in economics alter the behaviour they predict, which is why unconditional forecasts in social systems are structurally unstable.
Why it stays hidden
The instability hides because each individual driver’s response is rational: they received information and acted on it. The problem is not in any single decision but in the aggregate: if every driver responds to the forecast, the forecast destroys its own basis. The debrief sees only the empty bridge and concludes the model was wrong, because the reflexive loop is not a standard input to post-mortem analysis.
A prediction that enters the system it describes is no longer a prediction. It is a participant, and participants change outcomes.
A prediction that enters the system it describes is no longer a prediction. It is a participant, and participants change outcomes.
Collect this card
A prediction that enters the system it describes is no longer a prediction. It is a participant, and participants change outcomes.
0 / 10,000 collected
Sources & further reading 3
- Merton, "The Self-Fulfilling Prophecy", Antioch Review, 1948
- Grunberg & Modigliani, "The Predictability of Social Events", Journal of Political Economy, 1954
- Simon, "Bandwagon and Underdog Effects of Election Predictions", Public Opinion Quarterly, 1954
Cross-references
Related files
Filed near this one in the index.
-
Hidden Logic Entry #0010
Why “free” costs more than one cent
Dropping a price from one cent to zero does not shave one cent off the decision. It changes which part of the brain makes it.
MasterThe hidden part #0010Zero is not the smallest price. It is a different category of thing entirely.
Logic Open file -
No visual on fileDecision Architecture Entry #0135
The reason irreversible choices feel better afterwards
An option that cannot be returned is rated higher than the same option with a return window. The closed door is doing the work.
MasterThe hidden part #0135A closed door stops the comparison loop. The mind then makes the best of what it has, and it is good at this.
Decisions Open file -
No visual on fileSocial Proof Entry #0205
Why a bestseller list creates the bestseller
A ranking that reports demand also produces it. Appearing on the list raises subsequent sales, so the measurement becomes part of what it measures.
MasterThe hidden part #0205A published ranking is an intervention. Measuring popularity changes the popularity being measured.
Social Proof Open file -
No visual on fileParadox & Proof Entry #0155
Why the average person has fewer friends than their friends
In almost every network, most members are less connected than their own contacts are on average. The comparison is rigged by how contacts get sampled.
MasterThe hidden part #0155Your contacts are a sample weighted by connection count. The comparison is against the well-connected by construction.
Paradox Open file
Annotations are reserved for archive members.
Sign in to annotate