schristoph.online

Tag

Observability

2 posts · all tags · all posts

2026

  1. Wrong, Not Broken: An Agent Evaluator Is Only as Good as Its Reference

    TL;DR: Matt Wood’s “Wrong, not broken” describes a refund agent that answers in 600 ms with zero errors and quotes $40 where the policy says $140, because it retrieved last quarter’s document [1]. …

    ObservabilityAgenticAILLMEvalsAIQualityOpenTelemetryCloudWatch

  2. Can You Trust a Swarm's Reasoning?

    TL;DR: When a collective of agents coordinates internally and a deployment surfaces only its final broadcast to you (a design I am positing to make the trust question concrete, not something the …

    AgenticAIMultiAgentAIAgentsObservabilityAmazonBedrock