Why punishing failure removes reporting, not failure
Penalties attach to the report, not to the event. Reports are voluntary and events are not, so the measurable quantity falls while the underlying one does not.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Penalising error reports halves reported errors while audits show no change. Why?
Correct answer: B
Option A is contradicted by the audits, which measure the underlying rate independently. Penalties attach to a voluntary action. Suppressing reports leaves no trace, so the metric improves while the organisation loses its only visibility.
A hospital introduces penalties for departments reporting medication errors. Reported errors fall by half within a quarter. Independent chart audits find the underlying rate unchanged. The programme succeeded against its metric and failed against its purpose.
What everyone sees
The initial figures look like a successful intervention, and are usually presented as one. The gap only appears when a second measurement channel exists that is not subject to the same incentive, and most organisations do not maintain one, so the apparent success stands unchallenged.
What is actually happening
Campbell’s law holds that the more a quantitative indicator is used for decision-making, the more it will be corrupted. Errors are events; reports are actions taken by people who can choose otherwise, so a penalty applies pressure to the action and not to the event. Edmondson’s research on psychological safety found that teams reporting more errors often had better outcomes, because reporting reflected willingness to disclose rather than incidence. Reason’s work on safety culture argues that reporting depends on the reporter believing disclosure is safe, which a penalty directly removes.
Why it stays hidden
The substitution hides because the numbers move in the intended direction. A falling line on a dashboard reads as improvement, and there is no visible artefact of suppression — an unwritten report leaves nothing behind. The organisation also loses the information it would need to detect the problem, so the intervention degrades the instrument it is being judged by.
A penalty on reports does not reduce the events. It reduces the only record that the events occurred.
A penalty on reports does not reduce the events. It reduces the only record that the events occurred.
Collect this card
A penalty on reports does not reduce the events. It reduces the only record that the events occurred.
0 / 10,000 collected
Sources & further reading 2
- Campbell — assessing the impact of planned social change
- Edmondson — psychological safety and learning behavior in work teams
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileStatistical Illusions Entry #0436
Why a p-value is not a probability that you are right
The p-value measures how surprising the data would be if the null hypothesis were true. It says nothing about the probability that the hypothesis itself is true.
NoviceThe hidden part #0436A p-value tells you how surprising the data is. It does not tell you how true the hypothesis is.
Statistics Open file -
No visual on fileScarcity & Queues Entry #0461
Why a paywall creates a different reader
The paywall does not merely filter who reads. It changes how the remaining readers read, because the cost they paid becomes part of the experience.
NoviceThe hidden part #0461The paywall does not select better readers. It makes the same readers better at reading.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0457
Why a members-only door raises the perceived quality inside
A restriction implies that something is being protected. The inference is made before anything inside has been seen, and it survives finding nothing there.
NoviceThe hidden part #0457Restriction and value are separable. The door can be installed first, and the perceived quality assembles itself behind it.
Scarcity Open file -
No visual on fileScarcity & Queues Entry #0451
Why a limited edition raises value without raising quality
The product is identical. The only thing that changed is the number that will be made, and that number changed the price people are willing to pay.
NoviceThe hidden part #0451Supply constraint is a design decision. The limited edition does not discover rarity; it manufactures it and lets the market treat the result as worth.
Scarcity Open file
Annotations are reserved for archive members.
Sign in to annotate