July 15, 2026 Why AI Tokens Are So Expensive — and What Actually Makes Them Cheaper

TL;DR: Autoregressive LLM generation has two phases with different bottlenecks: prefill processes input positions in parallel and is usually compute-intensive, while decode produces tokens sequentiall…