Why a lagging statistic invites the wrong correction
The number describes a situation that has already moved. Acting hard on it applies force in the direction the system has just finished going.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Why does acting decisively on a delayed statistic produce instability?
Correct answer: B
Option A conflates timeliness with accuracy. Option C blames temperament for a structural effect. Participants in controlled distribution experiments generate large oscillations even with stable demand by underweighting delivery delays, and order variability amplifies away from the customer with delayed and batched information as a principal cause.
Stock reports arrive six weeks late. The shortage is visible in the report, so orders are doubled; by the time the order lands, demand has normalised and the warehouse is full. Next quarter the report shows a glut, and orders are cut into a recovery.
What everyone sees
A measurement is trusted as a description of now, so a strong response to a clear signal looks like competence. The signal is a description of then. When the delay between the state and its measurement is comparable to the time the system takes to change, a proportional response is systematically mistimed.
What is actually happening
Sterman ran a controlled distribution experiment and found participants generated large oscillations even with stable end demand, because they underweighted the delay between ordering and delivery and over-corrected against the information they could see — the instability produced by the decision rule rather than by the environment. Lee, Padmanabhan and Whang identified the industrial version, showing that order variability amplifies at each step away from the customer, with delayed and batched information among the principal causes. Neither result requires anybody to be careless. The oscillation is generated by responding sensibly to numbers that describe a past state, and the strength of the response determines the size of the swing.
Why it stays hidden
The mistiming hides because each decision is defensible on its own evidence. The report said shortage; ordering more was correct. Reviews examine decisions individually against the data available, which is exactly the frame in which a delay-induced oscillation looks like a series of reasonable calls and bad luck.
When the measurement lag matches the system’s response time, a proportional correction becomes an oscillation. Each step is defensible; the sequence is not.
When the measurement lag matches the system’s response time, a proportional correction becomes an oscillation. Each step is defensible; the sequence is not.
Collect this card
When the measurement lag matches the system’s response time, a proportional correction becomes an oscillation. Each step is defensible; the sequence is not.
0 / 10,000 collected
Sources & further reading 2
- Sterman — modeling managerial behavior: misperceptions of feedback in a dynamic decision making experiment
- Lee, Padmanabhan & Whang — information distortion in a supply chain: the bullwhip effect
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0436
Why a p-value is not a probability that you are right
The p-value measures how surprising the data would be if the null hypothesis were true. It says nothing about the probability that the hypothesis itself is true.
NoviceThe hidden part #0436A p-value tells you how surprising the data is. It does not tell you how true the hypothesis is.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0461
Why a paywall creates a different reader
The paywall does not merely filter who reads. It changes how the remaining readers read, because the cost they paid becomes part of the experience.
NoviceThe hidden part #0461The paywall does not select better readers. It makes the same readers better at reading.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0457
Why a members-only door raises the perceived quality inside
A restriction implies that something is being protected. The inference is made before anything inside has been seen, and it survives finding nothing there.
NoviceThe hidden part #0457Restriction and value are separable. The door can be installed first, and the perceived quality assembles itself behind it.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0451
Why a limited edition raises value without raising quality
The product is identical. The only thing that changed is the number that will be made, and that number changed the price people are willing to pay.
NoviceThe hidden part #0451Supply constraint is a design decision. The limited edition does not discover rarity; it manufactures it and lets the market treat the result as worth.
Scarcity Open file
Annotations are reserved for archive members.
Sign in to annotate