Attention

2 posts tagged Attention  Âˇ  all tags

2026

Weekly Review — July 20-26, 2026

TL;DR: Three posts about the cost you can’t see until you go looking. “Laws & Disorder” continues with Hyrum’s Law: every observable behavior of your API is a contract someone depends on, and AI agent…

The Quadratic Wall: The Algorithmic Race to Beat O(n²) Attention

TL;DR: Standard self-attention costs on the order of n² in the sequence length n, in both arithmetic and the attention-score memory it materialises. Almost every long-context architecture headline of …

← Back to all posts