Topic
evaluation
3 posts tagged “evaluation”.
-
How to Build a Golden-Question Benchmark for Your Data Agents
Build a golden-question benchmark for data agents: frozen Iceberg tags, execution-based scoring with Arrow, and CI gates.
-
Release Management for Data Agents: Shipping Prompts, Tools, Models, and Metrics Without Breaking Answers
Ship prompts, tools, models, and metric changes without breaking answers: agent manifests, shadow mode, canaries, and rollback.
-
The Buyer's Scorecard for Agentic Analytics: Evaluating Tooling in the Enterprise AI Era
Agentic analytics demos are easy to enjoy and hard to evaluate. A user asks a question, an assistant answers, a chart appears, and the room leans f...