schristoph.online

Tag

Inference

2 posts · all tags · all posts

2026

  1. Serving a Decision Model on SageMaker AI, and Measuring What You Serve

    TL;DR: Part 1 fine-tuned Qwen3.5-4B into a decision model that returns probabilities over declared options. Serving it with llama.cpp needs llama.cpp b11443 or newer, which Unsloth’s exporter source …

    SageMakerInferenceAIAgentsEvaluationCostOptimizationHandsOn

  2. Intelligence Is About Time, Not Parameters

    The Question Every SA Gets Beyond a complexity threshold, larger models become less insightful, the savant regime. “Which model should I use?” I hear it in almost every customer conversation about …

    AIInferenceModelsArchitectureAWSAmazonBedrock