TL;DR: Information theory says prediction and compression are the same thing measured two ways. That gives the cleanest mental model I know for what a large language model does: it is a compressor of …
1 post tagged LLMs · all tags
TL;DR: Information theory says prediction and compression are the same thing measured two ways. That gives the cleanest mental model I know for what a large language model does: it is a compressor of …