Uncategorized
World Models: Prediction as Understanding
To understand something may be to be able to predict it.
Uncategorized
Uncategorized
Common Sense: The Knowledge We Never State
The hardest knowledge to give a machine is the knowledge no one bothers to say.
Uncategorized
Systematic Generalization
Understanding a few combinations should confer understanding of many.
Uncategorized
Counterfactuals: Reasoning About What Did Not Happen
To ask what would have happened is to reason about a world that never was.
Uncategorized
Compositionality: Infinite Meaning From Finite Parts
From a fixed vocabulary we build endless sentences, and from known concepts endless thoughts.
Uncategorized
Symbolic Versus Connectionist: Rules or Patterns
Is thought the manipulation of symbols or the settling of a network? Two traditions answer differently, one prizing explicit rules, the other emergent pattern.
Uncategorized
Causality Versus Correlation
That two things move together does not mean one moves the other.
Uncategorized
The Bitter Lesson: Computation Over Cleverness
Again and again, the elaborate hand-built method loses to the simple method that scales.
Uncategorized
Scaling: When Quantity Becomes Capability
Make a system larger, feed it more, and something changes in kind, not just degree.