Uncategorized
Compositionality: Infinite Meaning From Finite Parts
From a fixed vocabulary we build endless sentences, and from known concepts endless thoughts.
Uncategorized
Uncategorized
Symbolic Versus Connectionist: Rules or Patterns
Is thought the manipulation of symbols or the settling of a network? Two traditions answer differently, one prizing explicit rules, the other emergent pattern.
Uncategorized
Causality Versus Correlation
That two things move together does not mean one moves the other.
Uncategorized
The Bitter Lesson: Computation Over Cleverness
Again and again, the elaborate hand-built method loses to the simple method that scales.
Uncategorized
Scaling: When Quantity Becomes Capability
Make a system larger, feed it more, and something changes in kind, not just degree.
Uncategorized
Interpretability and the Wish to See Inside the Black Box
A system can be accurate and still be opaque.
Uncategorized
Specification Gaming: Optimizing the Letter, Not the Spirit
Ask precisely for the wrong thing and you will receive it.
Uncategorized
The Alignment Problem: Goals We Cannot Fully Specify
We build systems to pursue objectives, but our true wishes exceed what we can write down.
Uncategorized
Exploration Versus Exploitation: The Explorer’s Dilemma
Act on what you know, or seek what you don't? Every agent that learns from its choices faces this fork.