LIVE FEED — JUL 28, 2026
Uncategorized

The Bitter Lesson: Computation Over Cleverness

Again and again, the elaborate hand-built method loses to the simple method that scales.

By · July 7, 2026 · 2 min read

Again and again, the elaborate hand-built method loses to the simple method that scales. Human insight, painstakingly encoded, is overtaken by general approaches that merely consume more computation. The lesson is bitter because it demotes ingenuity.

The principle

The observation is that general methods leveraging computation tend to win over time. Approaches that encode human knowledge give early gains but plateau. Those that learn and search, given enough compute, surpass them.

The mechanism

The mechanism is that computation compounds while hand-built knowledge does not. As resources grow, general learners exploit them without limit, whereas crafted systems hit the ceiling of their assumptions. Scale rewards the humble method.

An unexpected turn

The turn stings because it seems to devalue understanding. The clever features and rules that felt like progress prove to be scaffolding the scaling method discards. Insight is not useless, but it is not the winner.

The hidden cost

The lesson is easily overstated. Structure and prior knowledge still matter, especially where data or compute are scarce. The claim is about the long run and the large scale, not every case.

The limit

The implication is a strategic humility. Betting against computation has repeatedly failed, so methods that ride its growth deserve the benefit of the doubt. Design for scale, not for cleverness alone.

The larger point

The bitter lesson holds that general, computation-hungry methods beat hand-crafted knowledge over time. Computation compounds where insight plateaus. It counsels designing for scale, however much that demotes human cleverness. Seen this way, the concept is less a fact to be filed than a lens through which other facts arrange themselves. Its worth lies not in any single application but in the pattern of thought it makes available. To hold it clearly is to see a whole family of problems as variations on one theme, and to recognize the same shape recurring where it was not expected.