data pipelines

1. September 10, 202630 min read

   What to Assert When You Test an Iceberg Pipeline

   Fixtures, in-memory catalogs, and golden metadata: the assertions that catch wrong rows, unsafe reruns, schema drift, and concurrent-write corruption in CI.

2. August 2, 202631 min read

   Designing Batch Pipelines That Write Well Into Apache Iceberg

   How to design batch pipelines that write well into Apache Iceberg: commit strategy, partitioning, sort order, write-audit-publish, and maintenance done right.

3. July 28, 202630 min read

   Building Iceberg Pipelines in Python Without Standing Up Spark

   A large share of production transformations fit comfortably on one machine. PyIceberg, DuckDB, and branch isolation give you a production path that debugs.

Browse all posts