TL;DR: Three posts about the cost you canât see until you go looking. âLaws & Disorderâ continues with Hyrumâs Law: every observable behavior of your API is a contract someone depends on, and AI agentâŚ
Attention
2 posts tagged Attention ¡ all tags
2026
Weekly Review â July 20-26, 2026
The Quadratic Wall: The Algorithmic Race to Beat O(n²) Attention
TL;DR: Standard self-attention costs on the order of n² in the sequence length n, in both arithmetic and the attention-score memory it materialises. Almost every long-context architecture headline of âŚ