Uncategorized
Autoencoding: Understanding by Reconstruction
Force a system to squeeze data through a narrow channel and rebuild it, and it must keep only what matters.
Uncategorized
Uncategorized
The Binding Problem
A scene is not a heap of features but an arrangement of objects, each with its own properties.
Uncategorized
Systematic Generalization
Understanding a few combinations should confer understanding of many.
Uncategorized
Compositionality: Infinite Meaning From Finite Parts
From a fixed vocabulary we build endless sentences, and from known concepts endless thoughts.
Uncategorized
Meta-Learning: Learning How to Learn
A learner can improve not only at a task but at learning itself.
Uncategorized
Counterfactuals: Reasoning About What Did Not Happen
To ask what would have happened is to reason about a world that never was.
Uncategorized
The Frame Problem: Knowing What Stays the Same
When something changes, most things do not.
Uncategorized
Credit Assignment: Which Action Earned the Reward
A reward arrives, but which of many past choices deserves the thanks? When cause and consequence are separated by time and tangled with chance, assigning credit is the central puzzle of learning to act..
Uncategorized
Catastrophic Forgetting: The Price of Learning Anew
To learn a new thing can be to lose an old one.
Uncategorized
Disentanglement: Factoring the World Into Its Causes
The world's appearances arise from a few underlying factors, mixed together.