Paradox & Proof Entry #0158 Classified Declassified

The reason more information can lower accuracy

Adding weakly relevant detail to a judgement raises confidence and often leaves accuracy flat or worse. The extra material dilutes the signal it was meant to sharpen.

No visual record attached The written record below is complete.
Plate 126 — five facts, suspended in fifteen more.

Intuition test — answer before you read on

Adding fifteen weakly relevant facts to five strong ones raises confidence but not accuracy. Why?

Forecasters are given five relevant facts and asked to predict an outcome. A second group receives the same five facts plus fifteen more of marginal relevance. The second group is markedly more confident. Their accuracy is no better, and on some tasks it is worse.

What everyone sees

More information is assumed to be strictly better, on the reasonable ground that a fact can be ignored if it is not useful. The assumption fails because irrelevant material is not ignored: it is averaged in, and averaging a strong signal with weak ones moves the estimate towards the middle.

What is actually happening

Nisbett and colleagues described the dilution effect, in which non-diagnostic information weakens the use of diagnostic information. Oskamp found that clinicians’ confidence rose substantially with additional case material while accuracy did not. Work on lens-model judgement, following Dawes, shows that simple models using few strong predictors frequently outperform richer ones, because added variables contribute more noise than signal.

Why it stays hidden

The effect hides because confidence is the only feedback available at the moment of judgement. Accuracy arrives later, if at all, and is rarely paired with a record of what was known. Requesting more information also looks diligent, so the behaviour is socially rewarded independently of its effect, and no institution keeps score of the version with fewer inputs.

Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.

Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.

The hidden part — entry #0158

Collect this card

Non-diagnostic detail is averaged in rather than ignored. Confidence tracks volume of information; accuracy tracks its quality.

0 / 10,000 collected

Sources & further reading 3
  1. Nisbett, Zukier & Lemley, "The Dilution Effect: Nondiagnostic Information Weakens the Implications of Diagnostic Information", Cognitive Psychology, 1981
  2. Oskamp, "Overconfidence in Case-Study Judgments", Journal of Consulting Psychology, 1965
  3. Dawes, "The Robust Beauty of Improper Linear Models in Decision Making", American Psychologist, 1979

Circulate this file

Annotations are reserved for archive members.

Sign in to annotate