Statistical Illusions Entry #0427 Classified Declassified

The reason a rising rate can mean a shrinking problem

The rate went up and the headline called it a crisis. The count went down and nobody mentioned it. Both statements described the same data.

No visual record attached The written record below is complete.
Plate 68 — a graph in which the alarm line and the relief line were the same data.

Intuition test — answer before you read on

Bicycle accidents per cyclist rise 15% while the total number of accidents falls. Which statement is true?

A city reports that the rate of bicycle accidents per cyclist has risen by fifteen per cent. The headline warns of worsening road safety. Left unmentioned: the number of cyclists tripled over the same period, and the absolute number of accidents actually fell. More people are cycling more safely in total, but the rate-based story tells the opposite.

What everyone sees

Readers accept the rate as the natural unit of alarm. A rising rate reads as deterioration, and because rates are normalised — per capita, per mile, per user — they feel more scientific than raw counts. The normalisation is treated as a correction for scale, so the corrected number is trusted more than the uncorrected one, even when the correction obscures the improvement it was supposed to clarify.

What is actually happening

Rates and counts can move in opposite directions whenever the denominator changes faster than the numerator. This is a mathematical identity, not a fallacy, but it becomes misleading when only one metric is reported. Gigerenzer has argued that confusion between rates and counts is one of the most common sources of statistical illiteracy, and that presenting both together — along with the denominator — is the minimum standard for honest reporting. The bicycle example is structurally identical to cases in healthcare, crime and education where expanding the base population inflates the rate while the absolute burden decreases.

Why it stays hidden

The confusion hides because rates and counts answer different questions and are rarely displayed together. The rate answers “how risky is cycling for a cyclist?”, and the count answers “how many accidents is the city dealing with?” Both are legitimate, but a headline can only carry one, and the one that sounds like a crisis gets the headline. The shrinking problem is invisible because no one asked the shrinking question.

Denominators move independently. A rising rate can coexist with a falling count whenever the base grows faster than the outcome.

Denominators move independently. A rising rate can coexist with a falling count whenever the base grows faster than the outcome.

The hidden part — entry #0427

Collect this card

Denominators move independently. A rising rate can coexist with a falling count whenever the base grows faster than the outcome.

0 / 10,000 collected

Sources & further reading 3
  1. Gigerenzer, "Calculated Risks: How to Know When Numbers Deceive You", 2002
  2. Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz & Woloshin, "Helping Doctors and Patients Make Sense of Health Statistics", Psychological Science in the Public Interest, 2007
  3. Spiegelhalter, "The Art of Statistics: Learning from Data", 2019

Circulate this file

Annotations are reserved for archive members.

Sign in to annotate