data-quality

1. October 28, 202633 min read

   Primary Keys Come to Apache Iceberg V4, and Most of Them Start Out Unenforced

   Apache Iceberg V4 adds primary key, unique and check constraints, an enforced flag and per-snapshot status. What the spec says and how to prepare tables.

2. October 5, 202630 min read

   When a Data Agent Gives a Wrong Number: Incident Response for Agentic Analytics

   A plan for when a data agent gives a wrong number: severity levels, containment, Iceberg time travel reproduction, and blast radius queries.

3. September 28, 202630 min read

   Twelve Queries That Pass Every Schema Check and Still Return the Wrong Number

   Twelve query patterns that pass schema validation and still return wrong numbers, with detectors, required metadata, and tested code for each.

4. September 2, 202630 min read

   Data Quality Tooling Compared: Great Expectations, Soda, dbt Tests, and Anomaly Detection

   A comparison of Great Expectations, Soda, dbt tests, and anomaly detection, and a layered design that uses each where it fits.

5. August 19, 202630 min read

   Goal-Directed Data Quality Agents: Anomaly Quarantine on Apache Iceberg

   Goal-directed data quality agents that watch Apache Iceberg tables, detect anomalies, and quarantine suspect data safely with snapshot isolation and branches.

6. July 25, 202630 min read

   Freshness Is a Contract, Not a Note on a Dashboard

   Data freshness needs to become an engineering contract with a measurable value, an owner, and consequences.

Browse all posts