Why the feed shows what keeps you, not what you wanted
A ranked feed is optimised for the next minute of attention rather than for the thing you opened the application to do.
Filed by The Archivist 2 min read
Intuition test — answer before you read on
A ranking model is trained to predict expected watch time. Which kind of item will it most reliably under-serve?
Correct answer: B
Anything valuable but unclicked is invisible to a behaviour-trained objective. This is why platforms bolt on satisfaction surveys and diversity terms: they are attempts to smuggle unobservable value back into a system that can only see actions.
You open an application to check one item. Forty minutes later you close it having seen a hundred, none of which you asked for and most of which you enjoyed. The session is usually described as a failure of self-control. It is more accurately described as a solved optimisation problem.
What everyone sees
The everyday account is that recommendation systems learn your taste and return more of it. Feeds feel personal, so the objective is assumed to be preference matching, and a poor match is filed as a bug rather than as a different target being hit accurately.
What is actually happening
Production ranking systems are trained on signals that can be logged: watch time, dwell, click, completion, return within a day. Preference is not observable; behaviour is. Published descriptions of large recommenders state plainly that the model predicts expected watch time or interaction, a quantity that tracks satisfaction in the common case and separates from it in the tail.
Why it stays hidden
The divergence is invisible from inside the session, because the feed is never wrong in the moment: each item genuinely beats the alternative of closing the application. There is also no counterfactual on screen. You cannot see the session you would otherwise have had, so the only evidence of misalignment is a feeling afterwards — the one kind of evidence a metric cannot absorb.
A feed answers what will keep you here, which is a different question from what you came for.
A feed answers what will keep you here, which is a different question from what you came for.
Collect this card
A feed answers what will keep you here, which is a different question from what you came for.
0 / 10,000 collected
Sources & further reading 3
- Gomez-Uribe & Hunt, "The Netflix Recommender System", ACM Transactions on Management Information Systems, 2015
- Covington, Adams & Sargin, "Deep Neural Networks for YouTube Recommendations", RecSys, 2016
- Hosanagar, Fleder, Lee & Buja, "Will the Global Village Fracture into Tribes?", Management Science, 2014
Cross-references
Related files
Filed near this one in the index.
-
No visual on filePlatform Mechanics Entry #0282
Why recommendation systems narrow taste while widening catalogue
The library grows every month and the same titles keep arriving at the top. Availability and discoverability are separate quantities that can move apart.
NoviceThe hidden part #0282Catalogue size and reachable set are different numbers. Recommendation confidence is built from attention already spent.
Platforms Open file -
Hidden Mechanics Entry #0009
Why elevator close buttons do nothing
In most lifts installed since the early nineties, the door-close button is disconnected for everyone except firefighters. It still lights up. That is the point.
NoviceThe hidden part #0009The button is not wired to the door. It is wired to your patience.
Mechanics Open file -
No visual on filePlatform Mechanics Entry #0286
Why moderation is a pricing problem, not a values problem
At scale, every piece of content must be reviewed at a cost that approaches zero. The cost determines what gets caught, and the values follow the budget.
NoviceThe hidden part #0286Values are free to declare. Moderation costs money per decision. At scale, the budget determines what the values actually mean.
Platforms Open file -
No visual on fileHabit Loops Entry #0303
Why changing a route changes a routine
A habit feels like a decision stored in the person, but it is actually stored in the environment. Move the person and the habit loses its cue.
NoviceThe hidden part #0303Habits are stored with their surroundings. Change the surroundings and the habit has to be rebuilt from scratch — or it simply does not fire.
Habit Open file
Annotations are reserved for archive members.
Sign in to annotate