The reason a habit survives the loss of its reward
The reward that started the habit can vanish entirely, and the habit continues. What was once a means to an end has become the end itself.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
A rat is extensively trained to press a lever for food. The food is then removed. What happens?
Correct answer: B
Extensive training transfers the behaviour from the goal-directed system to the habitual system. Once habitual, the behaviour is triggered by context cues and no longer checks whether the outcome is still available. The lever press has outlived its purpose.
A laboratory rat learns to press a lever for a sugar pellet. After several hundred repetitions the pellet is removed. The rat keeps pressing. It presses long after the pellet would have been consumed, long after a new rat placed in the same cage and given the same removal would never press at all. The lever has outlived its reason.
What everyone sees
Observers interpret persistent behaviour as either confusion or hope: the rat has not noticed the pellet is gone, or it expects the pellet to return. Both explanations assume the behaviour is still goal-directed. What they do not consider is that the behaviour has changed category — from instrumental (press to receive) to automatic (press because pressing is what happens here).
What is actually happening
Research on habit formation distinguishes between goal-directed and habitual action. Dickinson, Wood and Quinn, and others have shown that extensive repetition shifts behaviour from the goal-directed system (sensitive to outcome) to the habitual system (triggered by context, insensitive to outcome). Adams demonstrated that rats trained extensively still performed the lever press even after the food was devalued, whereas rats with less training stopped immediately. The habit had become stimulus-bound: the cue triggered the response without consulting the goal.
Why it stays hidden
The transition hides because the behaviour looks the same from the outside. A goal-directed lever press and a habitual lever press produce the same motion, so the observer — and often the performer — cannot tell which system is in control without running a devaluation test. In everyday life, people drive the same route, check the same app, and reach for the same snack long after the original reason has expired, and because the motion is familiar it feels chosen rather than automatic.
Repetition outlives reinforcement. The habit that was built by a reward no longer needs it, and no longer checks.
Repetition outlives reinforcement. The habit that was built by a reward no longer needs it, and no longer checks.
Collect this card
Repetition outlives reinforcement. The habit that was built by a reward no longer needs it, and no longer checks.
0 / 10,000 collected
Sources & further reading 3
- Adams, "Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation", Quarterly Journal of Experimental Psychology, 1982
- Wood & Quinn, "Habits — A Repeat Performance", Current Directions in Psychological Science, 2005
- Dickinson, "Actions and Habits: The Development of Behavioural Autonomy", Philosophical Transactions of the Royal Society B, 1985
Cross-references
Related files
Filed near this one in the index.
-
Hidden Mechanics Entry #0008
The hole in your pen cap is a lung
That small hole in the top of a ballpoint cap is not for airflow to the ink, or for pressure, or for manufacturing. It is there because people chew pens and occasionally swallow the cap.
Adept -
No visual on filePlatform Mechanics Entry #0287
The reason a platform’s rules change after you build on them
The rules were generous when they needed builders. Once the builders are invested, the rules can be revised, because the cost of leaving exceeds the cost of complying.
AdeptThe hidden part #0287Generous terms attract investment. Investment creates dependency. Dependency permits revision. The sequence is not accidental.
Platforms Open file -
No visual on filePlatform Mechanics Entry #0284
Why network effects make second place worthless
The value of the first network rises with each user. The value of the second rises too, but the gap between them widens rather than closes.
AdeptThe hidden part #0284The first network large enough owns the people. The second can copy every feature except the one that matters.
Platforms Open file -
No visual on filePersuasion Systems Entry #0262
The reason storytelling disarms counter-argument
An argument invites a counter-argument. A story invites the listener inside, and the interior is not a place from which counter-arguments are launched.
AdeptThe hidden part #0262An argument is evaluated. A story is entered. Inside the story, the machinery that produces objections is occupied elsewhere.
Persuasion Open file
Annotations are reserved for archive members.
Sign in to annotate