LIVE FEED — JUL 28, 2026
Uncategorized

Kolmogorov Complexity: The Length of the Shortest Description

The complexity of an object is the length of the shortest program that produces it.

By · July 7, 2026 · 2 min read

The complexity of an object is the length of the shortest program that produces it. A string of a million repeated digits is simple; a string of true randomness is not. This notion gives complexity a precise, if uncomputable, meaning.

The claim

Kolmogorov complexity defines the complexity of an object as the size of the smallest program that outputs it. Regular objects have short programs; random ones have none shorter than themselves. Complexity is incompressibility.

Beneath the surface

The mechanism is universality. Because any general-purpose computer can simulate another, the measure is fixed up to a constant regardless of language. The definition is machine-independent in the limit.

A reframing

The turn is a definition of randomness. A string is random exactly when it has no description shorter than itself, so randomness becomes the absence of pattern. Disorder is incompressibility.

The trade-off

The measure cannot be computed. No algorithm can find the shortest program in general, so Kolmogorov complexity is defined but not calculable. It is a north star, not a tool.

Where it breaks

The implication reaches across fields. It grounds notions of simplicity, randomness, and information in a single idea, informing learning, physics, and mathematics alike. Description length becomes a foundation.

The larger point

Kolmogorov complexity is the length of the shortest program producing an object, equating complexity with incompressibility and defining randomness as patternlessness. It is universal yet uncomputable. It grounds simplicity and information in one uncomputable ideal. What makes the idea durable is not that it settles a question but that it reframes many. It teaches where to look and what to discount, which is often more valuable than any particular answer it yields. Understood in this spirit, it becomes a habit of attention rather than a doctrine, and habits of attention are what distinguish deep comprehension from mere knowledge.