Latest post
What Apache Polaris 1.9.0 Brings to Low-Egress Multi-Cloud Catalogs
What Apache Polaris 1.9.0 adds for multi-cloud lakehouses: Cloudflare R2 credential vending, a DynamoDB persistence backend, and the Iceberg 1.12 client.
The archive
652 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
Latest post
What Apache Polaris 1.9.0 adds for multi-cloud lakehouses: Cloudflare R2 credential vending, a DynamoDB persistence backend, and the Iceberg 1.12 client.
How data agents prune enterprise schemas down to the columns that matter, ground filter values, and pick few-shot SQL examples with the right shape.
A platform engineer's upgrade guide to Apache Iceberg 1.12.0: variant and geospatial changes, REST catalog behavior, removed APIs, and rollback.
Build a golden-question benchmark for data agents: frozen Iceberg tags, execution-based scoring with Arrow, and CI gates.
A plan for when a data agent gives a wrong number: severity levels, containment, Iceberg time travel reproduction, and blast radius queries.
Serve many customers from one lakehouse without leaking between them: isolation models, Polaris grants, and tenant-scoped agent state.
Ship prompts, tools, models, and metric changes without breaking answers: agent manifests, shadow mode, canaries, and rollback.
Cache data agent results safely with canonical query keys, Iceberg snapshot freshness checks, and permission-aware cache keys.
Where small language models win inside a data agent and where they fail, plus a routing architecture that escalates only when needed.
AI slop means low-quality content, not AI-assisted work. The three markers of slop, and the review habits that separate skilled AI-assisted work from filler.