The reason more information can lower accuracy
Adding weakly relevant detail to a judgement raises confidence and often leaves accuracy flat or worse. The extra material dilutes the signal it was meant to sharpen.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Adding fifteen weakly relevant facts to five strong ones raises confidence but not accuracy. Why?
Correct answer: B
Nisbett and colleagues documented the dilution effect: non-diagnostic material weakens the use of diagnostic material rather than being discarded. Oskamp found confidence rising with case volume while accuracy stayed flat, and simple few-predictor models often beat richer ones.
Forecasters are given five relevant facts and asked to predict an outcome. A second group receives the same five facts plus fifteen more of marginal relevance. The second group is markedly more confident. Their accuracy is no better, and on some tasks it is worse.
What everyone sees
More information is assumed to be strictly better, on the reasonable ground that a fact can be ignored if it is not useful. The assumption fails because irrelevant material is not ignored: it is averaged in, and averaging a strong signal with weak ones moves the estimate towards the middle.
What is actually happening
Nisbett and colleagues described the dilution effect, in which non-diagnostic information weakens the use of diagnostic information. Oskamp found that clinicians’ confidence rose substantially with additional case material while accuracy did not. Work on lens-model judgement, following Dawes, shows that simple models using few strong predictors frequently outperform richer ones, because added variables contribute more noise than signal.
Why it stays hidden
The effect hides because confidence is the only feedback available at the moment of judgement. Accuracy arrives later, if at all, and is rarely paired with a record of what was known. Requesting more information also looks diligent, so the behaviour is socially rewarded independently of its effect, and no institution keeps score of the version with fewer inputs.
Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.
Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.
Collect this card
Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.
0 / 10,000 collected
Sources & further reading 3
- Nisbett, Zukier & Lemley, "The Dilution Effect: Nondiagnostic Information Weakens the Implications of Diagnostic Information", Cognitive Psychology, 1981
- Oskamp, "Overconfidence in Case-Study Judgments", Journal of Consulting Psychology, 1965
- Dawes, "The Robust Beauty of Improper Linear Models in Decision Making", American Psychologist, 1979
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileSocial Proof Entry #0212
The reason a room applauds before deciding it enjoyed it
The clap is not a verdict on the performance. It is a motor response to a social cue, and the verdict is constructed afterwards to match it.
AdeptThe hidden part #0212The room does not applaud because it decided. It decides because it applauded.
Social Proof Open file -
No visual on fileSocial Proof Entry #0209
Why you copy the person one step ahead, not the expert
The expert is too far away to imitate usefully. The person one step ahead is close enough that their success looks attainable and their method looks replicable.
AdeptThe hidden part #0209Expertise shows where to go. Proximity shows how to step. Only the step changes behaviour.
Social Proof Open file -
No visual on fileSocial Proof Entry #0208
The reason a small minority can shift a whole norm
A committed minority does not need to outnumber the majority. It needs to outlast it, because indifference yields to persistence.
AdeptThe hidden part #0208A committed minority does not convert the majority. It makes conversion cheaper than resistance.
Social Proof Open file -
Hidden Logic Entry #0011
Why nobody calls for help in a crowd
More witnesses does not mean more help. Past a certain crowd size, the probability that any individual acts collapses — and everyone involved believes they behaved reasonably.
Adept
Annotations are reserved for archive members.
Sign in to annotate