Statistical Illusions Entry #0429 Classified Declassified

The reason two true statistics can contradict each other

One batter can have a higher average than another in every single season and a lower average across both. Neither figure is wrong; the weighting differs.

No visual record attached The written record below is complete.
Plate 107 — two seasons, three averages, no error.

Intuition test — answer before you read on

A player leads in each of two seasons but trails over the two combined. What is happening?

Two baseball players. In 1995 the first has the higher batting average. In 1996 the first again has the higher batting average. Combine the two seasons and the second player leads. This is not a rounding artefact and it is not rare; it happened with Derek Jeter and David Justice across those exact years.

What everyone sees

The pair of statements looks like a contradiction, so one of them is assumed to be a mistake or a manipulation. Readers ask which number is the real one. The question has no answer, because both are correctly computed from the same records and they are answering different questions.

What is actually happening

A combined average is a weighted mean, and the weights are the number of attempts in each period. If one player took most of their attempts in the easier season and the other in the harder one, the aggregate can reverse the direction of every component. This is Simpson’s paradox seen from the arithmetic side: the grouping variable, not the performance, determines the sign of the comparison.

Why it stays hidden

The mechanism hides because averages are presented without their weights. A percentage looks self-contained, and the denominators that produced it are usually dropped in the reporting. Nothing in the format signals that two correctly computed figures can point opposite ways, so the reader defaults to assuming one side is being dishonest.

A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.

A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.

The hidden part — entry #0429

Collect this card

A combined average is weighted by attempt counts. Change the weights and the comparison can reverse without any figure being wrong.

0 / 10,000 collected

Sources & further reading 3
  1. Simpson, "The Interpretation of Interaction in Contingency Tables", Journal of the Royal Statistical Society, 1951
  2. Blyth, "On Simpson’s Paradox and the Sure-Thing Principle", Journal of the American Statistical Association, 1972
  3. Ross, "A Mathematician at the Ballpark", 2004

Circulate this file

Annotations are reserved for archive members.

Sign in to annotate