The reason a backup can lower reliability
A second unit adds a component, a switch, a test and an assumption. Each is a new way to fail, and one of them fails silently.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Why can adding a backup reduce overall system reliability?
Correct answer: B
Option A is not generally true and is not required. Option C is a real budget effect but secondary. Added components raise interactive complexity and coupling, and redundancy has been shown to create new common-mode failure paths, encourage higher risk-taking and diffuse responsibility — while a standby’s condition goes unobserved during normal operation.
The redundant pump is installed, the changeover valve is added, and the system now has two pumps and one valve that has never been operated. Eleven months later the primary fails, the valve does not turn, and the outage is longer than it would have been with one pump.
What everyone sees
Redundancy is treated as arithmetic: two units, each failing independently, give a combined failure probability equal to the product. That calculation is correct under its assumptions. The assumptions are independence, correct switching and known state of the standby, and installing a backup weakens all three.
What is actually happening
Perrow’s analysis of complex systems argues that added components increase interactive complexity and tight coupling, generating failure modes that are not present in any component and are not anticipated in the design. Sagan examined redundancy in high-hazard organisations and identified three specific mechanisms by which it can reduce reliability: added components create new common-mode failure paths, redundancy encourages higher risk-taking because the margin is believed to exist, and responsibility diffuses when more than one element is nominally responsible for the same function. The standby also has a distinctive property that a primary does not: its condition is unobserved during normal operation, so its failure produces no signal until the moment it is required.
Why it stays hidden
The added risk hides because the failure is counterfactual. A system that survives is credited to its redundancy, while the outage caused by an untested changeover is recorded as a valve fault rather than as a consequence of the design that introduced the valve. And the untested component looks like protection for its entire silent life.
Redundancy adds components, switching and an unobserved state. The standby’s failure produces no signal until the moment it is needed.
Redundancy adds components, switching and an unobserved state. The standby’s failure produces no signal until the moment it is needed.
Collect this card
Redundancy adds components, switching and an unobserved state. The standby’s failure produces no signal until the moment it is needed.
0 / 10,000 collected
Sources & further reading 2
- Perrow — normal accidents: living with high-risk technologies
- Sagan — the limits of safety: organisations, accidents and nuclear weapons
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileSocial Proof Entry #0211
Why the fifth person in a group stops arguing
Four unanimous voices do not just outnumber the dissenter. They make dissent feel like a defect rather than a difference of opinion.
NoviceThe hidden part #0211Unanimity does not mean everyone agrees. It means the cost of disagreement exceeded the value of the objection.
Social Proof Open file -
Hidden Logic Entry #0012
Why the second-cheapest wine always wins
Restaurants do not expect you to buy the cheapest bottle. They expect you to refuse it — and they price the list so that refusal lands exactly where the margin is fattest.
NoviceThe hidden part #0012The cheapest bottle is not for sale. It is a decoy that makes the next one up feel like restraint.
Logic Open file -
No visual on fileParadox & Proof Entry #0161
Why unanimous agreement lowers confidence in a verdict
Perfect consensus in a large group implies a shared error. The very agreement that looks like certainty is evidence against it.
NoviceThe hidden part #0161Perfect agreement among many is not strong evidence. It is evidence of a shared input, which may be the truth or may be the error.
Paradox Open file -
No visual on fileSocial Proof Entry #0203
Why a crowd forms around anyone looking up
One person staring at the sky is eccentric. Five people staring at the sky is a reason to stop. The content above is irrelevant; the signal below is sufficient.
NoviceThe hidden part #0203Others' attention is treated as evidence. The crowd does not discover the event; it creates the event by attending to it.
Social Proof Open file
Annotations are reserved for archive members.
Sign in to annotate