Why counting something changes what gets counted
A measure requires a definition, and once the measure is consequential the definition becomes something to be managed rather than merely applied.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Why does introducing a consequential measure change the activity being measured?
Correct answer: B
Option A describes fraud, which is neither necessary nor typical. Statistical categories rest on negotiated conventions, and studies of published rankings find organisations reorganise around the measure and resolve borderline cases favourably. The shift comes from applied definitions, not falsified entries.
Deciding to count anything requires drawing a boundary: what counts as an incident, a graduate, a customer, a resolved case. The boundary is a judgement made before any data exists. Once the count is used for decisions, that judgement becomes valuable, and the parties measured are the ones best placed to interpret it.
What everyone sees
Measurement is read as observation of something already there, with definitional questions treated as technical preliminaries. The definition is not a preliminary. It determines what the number refers to, and it is usually made by people who will later be assessed by it or who must rely on those people to apply it.
What is actually happening
Desrosières traced the history of statistical categories and showed that official numbers require conventions established through negotiation, so a statistic is the product of a definition and not only of counting. Espeland and Sauder studied what happens when such measures are published and consequential, describing reactivity: organisations reorganise their activity around the measure, redefine borderline cases in favourable ways, and the underlying activity shifts to match what is being recorded. Neither account treats this as fraud. The definition has to be applied by somebody, borderline cases are genuinely ambiguous, and consequences make the resolution of ambiguity systematically directional.
Why it stays hidden
The change hides because the series looks continuous. Definitions are adjusted, coding practices drift, and borderline cases resolve one way rather than another, none of which appears in the published figure. What is visible is a number that can be compared with last year, and the comparison assumes a stability that the definition itself does not have.
A number is a definition applied to the world. Make the number consequential and the definition becomes the thing under negotiation.
A number is a definition applied to the world. Make the number consequential and the definition becomes the thing under negotiation.
Collect this card
A number is a definition applied to the world. Make the number consequential and the definition becomes the thing under negotiation.
0 / 10,000 collected
Sources & further reading 2
- Desrosières — the politics of large numbers
- Espeland & Sauder — rankings and reactivity
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileIncentive Design Entry #0381
The reason a safety bonus can hide accidents
Paying a team for a clean record rewards two different things: fewer incidents and fewer reports. Only one of them is under the reporter’s direct control.
AdeptThe hidden part #0381An incentive on a reported number acts on the reporting. The absence of records is not the absence of events.
Incentives Open file -
No visual on fileStatistical Illusions Entry #0435
The reason a graph without zero can double an effect
Truncating the y-axis does not change the data. It changes the slope the eye sees, and the eye reads slope as magnitude before the mind reads the numbers.
MasterThe hidden part #0435A graph with correct data and a truncated axis is not lying about the numbers. It is lying about the shape.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0460
The reason rationing changes what people want
A product that was adequate becomes desirable when restricted. The restriction changed the inference the buyer draws, not the product itself.
MasterThe hidden part #0460A quota does not just limit access. It changes the inference about what is being accessed. The product behind the restriction is perceived as the product that deserved the restriction.
Scarcity Open file -
No visual on filePrice Psychology Entry #0360
The reason a currency without symbols raises spend
Remove the dollar sign and the number stops feeling like money. It becomes a score, and scores are spent differently from budgets.
MasterThe hidden part #0360A currency symbol is not information. It is a pain cue. Remove it and the number stays; the flinch goes.
Pricing Open file
Annotations are reserved for archive members.
Sign in to annotate