schristoph.online

Tag

InferenceCosts

2 posts · all tags · all posts

2026

  1. GLM 5.3 on Amazon Bedrock: An Open-Weight Coding Model Behind a Managed API, Tested

    TL;DR: GLM 5.3 from Z.ai is a mixture-of-experts coding model with roughly 750B total and about 40B active parameters, a 1M-token context and always-on reasoning, and it is now on Amazon Bedrock for …

    AILLMsAmazonBedrockOpenWeightsAgenticAIInferenceCosts

  2. Why AI Tokens Are So Expensive — and What Actually Makes Them Cheaper

    TL;DR: Autoregressive LLM generation has two phases with different bottlenecks: prefill processes input positions in parallel and is usually compute-intensive, while decode produces tokens …

    AILLMsAmazonBedrockInferenceCostsKVCache