2026
- Compression Is Intelligence
TL;DR: Information theory says prediction and compression are the same thing measured two ways. That gives the cleanest mental model I know for what a large language model does: it is a compressor of …
TL;DR: Information theory says prediction and compression are the same thing measured two ways. That gives the cleanest mental model I know for what a large language model does: it is a compressor of …