Why a correlation of one variable with time explains nothing
Two quantities that both rise over the years will correlate strongly with each other. The shared trend does the work and neither variable has touched the other.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Two unrelated series that both rise over decades correlate strongly. What is the diagnostic?
Correct answer: B
More data makes the spurious coefficient stronger, not weaker. Yule described this in 1926 and Granger and Newbold showed regressions on non-stationary series routinely produce apparently significant results. Removing the trend removes the association.
Plot mobile phone ownership against any quantity that has grown steadily since the nineteen-nineties and the correlation will be high. The pairing can be reversed to produce the opposite headline, using the same arithmetic, because the number being computed is not about the two subjects at all.
What everyone sees
A strong correlation coefficient is treated as a finding, and its size is reported as the strength of the relationship. The coefficient is honestly computed. What it measures, in a pair of trending series, is that both moved in the same direction over the same period — which was already known before either was measured.
What is actually happening
Time-series data commonly contain trends, and two independently trending series will show high correlation regardless of any connection. Yule described this as spurious correlation between time series in 1926, and Granger and Newbold demonstrated that regressions on non-stationary series produce apparently significant results routinely. Detrending or differencing the series usually removes the association entirely, which is the diagnostic.
Why it stays hidden
The artefact hides because the coefficient looks like a measurement of the relationship rather than of the trend. Charts also encourage it: two rising lines on shared axes read as a mechanism. Trended series are the most available data in the world, so the pairing is easy to produce, and the failure mode is a property of the method rather than of any dishonesty in the analyst.
Two trends will always agree. The coefficient reports the shared direction of time, not a relationship between the variables.
Two trends will always agree. The coefficient reports the shared direction of time, not a relationship between the variables.
Collect this card
Two trends will always agree. The coefficient reports the shared direction of time, not a relationship between the variables.
0 / 10,000 collected
Sources & further reading 3
- Yule, "Why Do We Sometimes Get Nonsense-Correlations between Time-Series?", Journal of the Royal Statistical Society, 1926
- Granger & Newbold, "Spurious Regressions in Econometrics", Journal of Econometrics, 1974
- Vigen, "Spurious Correlations", 2015
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0436
Why a p-value is not a probability that you are right
The p-value measures how surprising the data would be if the null hypothesis were true. It says nothing about the probability that the hypothesis itself is true.
NoviceThe hidden part #0436A p-value tells you how surprising the data is. It does not tell you how true the hypothesis is.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0461
Why a paywall creates a different reader
The paywall does not merely filter who reads. It changes how the remaining readers read, because the cost they paid becomes part of the experience.
NoviceThe hidden part #0461The paywall does not select better readers. It makes the same readers better at reading.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0457
Why a members-only door raises the perceived quality inside
A restriction implies that something is being protected. The inference is made before anything inside has been seen, and it survives finding nothing there.
NoviceThe hidden part #0457Restriction and value are separable. The door can be installed first, and the perceived quality assembles itself behind it.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0451
Why a limited edition raises value without raising quality
The product is identical. The only thing that changed is the number that will be made, and that number changed the price people are willing to pay.
NoviceThe hidden part #0451Supply constraint is a design decision. The limited edition does not discover rarity; it manufactures it and lets the market treat the result as worth.
Scarcity Open file
Annotations are reserved for archive members.
Sign in to annotate