The reason two true statistics can contradict each other
One batter can have a higher average than another in every single season and a lower average across both. Neither figure is wrong; the weighting differs.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
A player leads in each of two seasons but trails over the two combined. What is happening?
Correct answer: B
Both figures are correct. Combining seasons produces a weighted mean whose weights are the attempt counts, so a player who took most attempts in the harder season can lead every year and trail overall — Simpson’s paradox, arising purely from the grouping.
Two baseball players. In 1995 the first has the higher batting average. In 1996 the first again has the higher batting average. Combine the two seasons and the second player leads. This is not a rounding artefact and it is not rare; it happened with Derek Jeter and David Justice across those exact years.
What everyone sees
The pair of statements looks like a contradiction, so one of them is assumed to be a mistake or a manipulation. Readers ask which number is the real one. The question has no answer, because both are correctly computed from the same records and they are answering different questions.
What is actually happening
A combined average is a weighted mean, and the weights are the number of attempts in each period. If one player took most of their attempts in the easier season and the other in the harder one, the aggregate can reverse the direction of every component. This is Simpson’s paradox seen from the arithmetic side: the grouping variable, not the performance, determines the sign of the comparison.
Why it stays hidden
The mechanism hides because averages are presented without their weights. A percentage looks self-contained, and the denominators that produced it are usually dropped in the reporting. Nothing in the format signals that two correctly computed figures can point opposite ways, so the reader defaults to assuming one side is being dishonest.
A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.
A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.
Collect this card
A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.
0 / 10,000 collected
Sources & further reading 3
- Simpson, "The Interpretation of Interaction in Contingency Tables", Journal of the Royal Statistical Society, 1951
- Blyth, "On Simpson’s Paradox and the Sure-Thing Principle", Journal of the American Statistical Association, 1972
- Ross, "A Mathematician at the Ballpark", 2004
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0437
The reason a study that replicates is worth two that do not
A single study is a claim. A replication is a test of that claim. Two unreplicated studies are two untested claims, not twice the evidence.
AdeptThe hidden part #0437Novelty fills journals. Replication fills knowledge. The incentive structure rewards the wrong one.
Statistics Open file -
No visual on fileStatistical Illusions Entry #0434
Why a percentage change needs its starting point
A fifty per cent increase from two is one. A fifty per cent increase from two million is one million. The percentage is identical; the meaning is not.
AdeptThe hidden part #0434A percentage without a base is not a statistic. It is a frame looking for a denominator the reader will supply.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0462
The reason an invitation raises acceptance more than an offer
An offer says the item is available. An invitation says the recipient was selected. The difference is not in the item but in the identity it assigns.
AdeptThe hidden part #0462An offer presents a product. An invitation presents an identity. People accept identities faster than products.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0458
The reason an expiring discount beats a larger permanent one
A permanent reduction can be acted on at any time, which means it can be postponed indefinitely. A deadline converts an intention into a dated task.
AdeptThe hidden part #0458An open offer can be postponed forever. The deadline is not pressure; it is the thing that gives the intention a date.
Scarcity Open file
Annotations are reserved for archive members.
Sign in to annotate