Why the back half of a survey gets straight-line answers
The back half of a survey gets straight-line answers because response fatigue depletes the effort to discriminate, turning evaluation into pattern repetition.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
Why does response variance drop in the second half of a long survey?
Correct answer: A
Option B assumes interest tracks position, which studies control for. Option C is false when order is fixed. Option A is correct: satisficing theory explains the shift from careful evaluation to pattern repetition.
A market-research firm analysed thirty thousand completed surveys. Response variance — a measure of discriminating thought — dropped by thirty-four percent between the first and second halves. In the final quarter, respondents selected the same scale point on consecutive items sixty-one percent of the time. The data was collected; its second half was noise.
What everyone sees
Respondents believe they answered honestly throughout. They do not notice the decline in their own discrimination. The straightlining feels effortless because it is — which is precisely the problem. The ease is a symptom of depletion, not of consistent opinion.
What is actually happening
Krosnick’s satisficing theory shows that as cognitive resources deplete, respondents shift from optimising (choosing the best answer) to satisficing (choosing an acceptable answer with minimal effort). Straightlining — selecting the same response category repeatedly — is the most extreme form of satisficing. It produces data that looks complete but carries no signal, because the respondent is no longer evaluating each item independently.
Why it stays hidden
Straightlining hides because surveys look finished. Every question has an answer, and completion rates are high. The depletion is invisible in the response data until variance analysis reveals it. Researchers who trust completion rates over variance metrics are reading noise as signal.
A completed survey is not a valid survey. Completion measures obedience; variance measures thought. The back half may be full of answers and empty of meaning.
A completed survey is not a valid survey. Completion measures obedience; variance measures thought. The back half may be full of answers and empty of meaning.
Collect this card
A completed survey is not a valid survey. Completion measures obedience; variance measures thought. The back half may be full of answers and empty of meaning.
0 / 10,000 collected
Sources & further reading 2
- Krosnick — Response Strategies for Coping with the Cognitive Demands of Attitude Measures (1991)
- Tourangeau, Rips & Rasinski — The Psychology of Survey Response (2000)
Cross-references
Related files
Filed near this one in the index.
-
No visual on fileDecision Architecture Entry #0131
The reason you decide differently before and after lunch
Across a long session of similar decisions, the safe default is chosen more often as the session goes on. Why that happens is still argued about.
AdeptThe hidden part #0131Position in the queue is an unrecorded input. Effort-saving accumulates across a session while each case still gets a full justification.
Decisions Open file -
No visual on fileDecision Architecture Entry #0127
The reason a menu with two pages sells more than one with six
More options look generous until the person choosing them stops choosing. The tipping point between variety and paralysis is lower than most menus assume.
AdeptThe hidden part #0127Abundance converts into postponement. The menu that offers everything sells whichever item asks the least of the reader.
Decisions Open file -
No visual on fileHabit Loops Entry #0310
The reason morning habits stick better than evening ones
The morning slot faces less competition. By evening the day has introduced alternatives, interruptions and a depleted capacity to override them.
MasterThe hidden part #0310The morning slot is not filled by discipline. It is defended by emptiness — the absence of alternatives that have not yet arrived.
Habit Open file -
No visual on fileNaming & Sound Entry #0557
Why acronyms lose meaning and gain durability
Nobody can expand the three letters, and several of the words they once stood for name a business the firm no longer conducts.
NoviceThe hidden part #0557An opaque name cannot go out of date, because it never said anything a business could outgrow.
Naming Open file
Annotations are reserved for archive members.
Sign in to annotate