Why a question about method deflects a question about result

The finding is presented; the first response is about the sampling frame. It is a legitimate question with a real answer, and forty minutes later the meeting has discussed sampling, weighting and instrument wording, and has not discussed what the finding would mean if true.

What everyone sees

Methodological scrutiny is read as rigour, so more of it should mean better conclusions. Scrutiny applied selectively is not rigour. Every study has defects available for challenge, so the decision to raise them is where the reasoning happens — and that decision tracks whether the conclusion was welcome.

What is actually happening

Ditto and Lopez found that people apply asymmetric standards to evidence, requiring more information and scrutinising methodology harder before accepting conclusions they dislike, while accepting congenial findings on less — the differential appearing in how long they examined the procedure rather than in any stated refusal to believe. Edwards and Smith showed the same asymmetry inside argument evaluation: participants spent longer generating counter-arguments against claims that conflicted with prior beliefs and rated them weaker on grounds they could articulate. Both effects are invisible from the inside, because the objections raised are genuine ones. Nothing false is said. The selection of which true objection to pursue does the work.

Why it stays hidden

The deflection hides behind its own legitimacy. Method questions are exactly what a competent audience should ask, so refusing to engage looks like defensiveness and engaging consumes the available time. The test that would expose the asymmetry — whether the same scrutiny arrives for findings the room likes — is never run, because nobody records which questions were not asked.