Cognitive Bias Entry #0108 Classified Declassified

The reason you trust a confident stranger over a hesitant expert

Listeners weight advice by how certainly it is delivered, not by the record of the adviser. The market this creates rewards removing the caveats.

No visual record attached The written record below is complete.
Plate 122 — two forecasts, ranked by delivery.

Intuition test — answer before you read on

Audiences follow an unqualified forecast over a hedged one and rate its author as more competent. Why?

Two forecasts are offered on the same question. One is flat and unqualified. The other lists conditions, gives a range and names what would change the answer. Audiences follow the first, rate its author as more competent, and remember it as having been more useful even after both are scored.

What everyone sees

Confidence is treated as a proxy for knowledge because it often is: someone who has checked a fact says it plainly. The proxy is being used in a setting where it fails, since certainty is cheap to produce and requires no underlying accuracy to display.

What is actually happening

Price and Stone found that advisers who expressed higher confidence were weighted more heavily regardless of accuracy — a confidence heuristic. Tetlock’s long-run forecasting work found that the most accurate forecasters were the ones who qualified, updated and hedged, while the most publicly successful were the ones who did not. The two selection pressures point in opposite directions, and only one of them is visible to the audience.

Why it stays hidden

The distortion hides because the correction never arrives in a usable form. Forecasts are rarely scored publicly, the confident adviser is not present when the outcome lands, and audiences do not maintain records. Advisers meanwhile receive fast, clear feedback that hedging costs them attention, so the market removes caveats from the supply before the audience can learn to want them.

Certainty is cheap and accuracy is slow to verify. The channel rewards the signal that can be produced without the substance.

Certainty is cheap and accuracy is slow to verify. The channel rewards the signal that can be produced without the substance.

The hidden part — entry #0108

Collect this card

Certainty is cheap and accuracy is slow to verify. The channel rewards the signal that can be produced without the substance.

0 / 10,000 collected

Sources & further reading 3
  1. Price & Stone, "Intuitive Evaluation of Likelihood Judgment Producers: Evidence for a Confidence Heuristic", Journal of Behavioral Decision Making, 2004
  2. Tetlock, "Expert Political Judgment: How Good Is It? How Can We Know?", 2005
  3. Sniezek & Van Swol, "Trust, Confidence, and Expertise in a Judge-Advisor System", Organizational Behavior and Human Decision Processes, 2001

Circulate this file

Annotations are reserved for archive members.

Sign in to annotate