The reason a safety bonus can hide accidents
Paying a team for a clean record rewards two different things: fewer incidents and fewer reports. Only one of them is under the reporter’s direct control.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Recordable incidents halve after a safety bonus, while unincentivised first-aid log entries stay flat. What is the likely reading?
Correct answer: B
The unincentivised measure is the control. If underlying safety had improved, minor injuries would be expected to fall too. Research on injury reporting finds incentive schemes associated with reduced reporting, and non-reports leave no record, so the gain is unfalsifiable from inside.
A site introduces a bonus for completing a quarter with no recordable incidents. Recorded incidents fall by half within two quarters. Minor first-aid entries in the on-site log, which carry no bonus consequence, do not fall at all. Both numbers are accurate, and they describe different things.
What everyone sees
The falling incident count is presented as a safety improvement and celebrated as one. The bonus appears to have worked exactly as designed, and the design is unobjectionable: reward the outcome you want. The measure and the outcome are treated as the same object because the measure is the only view of the outcome available.
What is actually happening
When a metric depends on voluntary disclosure, an incentive attached to it acts on the disclosure as well as on the underlying event. Ruser and Butler and later work on injury reporting found evidence that safety incentive programmes and experience-rated premiums are associated with reduced reporting rather than reduced incidence alone. This is the reporting variant of Goodhart’s law: the measure ceases to be a good measure once it becomes a target.
Why it stays hidden
The suppression hides because non-reporting leaves no record by definition. There is no dataset of the incidents that were not written down, so the improvement is unfalsifiable from inside the system. Social pressure completes the concealment: reporting an incident now costs colleagues money, so silence is enforced horizontally rather than by management, and nothing in the paperwork shows it.
An incentive on a reported number acts on the reporting. The absence of records is not the absence of events.
An incentive on a reported number acts on the reporting. The absence of records is not the absence of events.
Collect this card
An incentive on a reported number acts on the reporting. The absence of records is not the absence of events.
0 / 10,000 collected
Sources & further reading 3
- Ruser & Butler, "The Economics of Occupational Safety and Health", Foundations and Trends in Microeconomics, 2010
- Goodhart, "Problems of Monetary Management: The UK Experience", 1975
- Bevan & Hood, "What’s Measured Is What Matters", Public Administration, 2006
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0437
The reason a study that replicates is worth two that do not
A single study is a claim. A replication is a test of that claim. Two unreplicated studies are two untested claims, not twice the evidence.
AdeptThe hidden part #0437Novelty fills journals. Replication fills knowledge. The incentive structure rewards the wrong one.
Statistics Open file -
No visual on fileStatistical Illusions Entry #0434
Why a percentage change needs its starting point
A fifty per cent increase from two is one. A fifty per cent increase from two million is one million. The percentage is identical; the meaning is not.
AdeptThe hidden part #0434A percentage without a base is not a statistic. It is a frame looking for a denominator the reader will supply.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0462
The reason an invitation raises acceptance more than an offer
An offer says the item is available. An invitation says the recipient was selected. The difference is not in the item but in the identity it assigns.
AdeptThe hidden part #0462An offer presents a product. An invitation presents an identity. People accept identities faster than products.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0458
The reason an expiring discount beats a larger permanent one
A permanent reduction can be acted on at any time, which means it can be postponed indefinitely. A deadline converts an intention into a dated task.
AdeptThe hidden part #0458An open offer can be postponed forever. The deadline is not pressure; it is the thing that gives the intention a date.
Scarcity Open file
Annotations are reserved for archive members.
Sign in to annotate