Uncategorized
Occam’s Razor: The Case for Simplicity
Faced with rival explanations that fit equally well, prefer the simpler.
Stories by Mahendra
Uncategorized
Mutual Information as a Measure of Relationship
How much does knowing one thing tell you about another? The question has a precise answer, a single number that captures dependence of any kind.
Uncategorized
Generative Versus Discriminative: Modeling the World or the Boundary
To tell cats from dogs, one can learn what separates them or learn what each is.
Uncategorized
Robustness Versus Accuracy
A model tuned to be right on average may be fragile to the unusual.
Uncategorized
Ensembles: The Wisdom of Many Models
One model has one set of blind spots; many, averaged, cover for each other.
Uncategorized
Calibration: Knowing How Much to Trust a Guess
A confident wrong answer is worse than an uncertain one.
Uncategorized
Modularity: Minds Built From Parts
A complex system is easier to build, understand, and repair when made of parts.