PyIceberg

1. September 10, 202630 min read

   What to Assert When You Test an Iceberg Pipeline

   Fixtures, in-memory catalogs, and golden metadata: the assertions that catch wrong rows, unsafe reruns, schema drift, and concurrent-write corruption in CI.

2. September 2, 202629 min read

   Local Iceberg Development Environments: Docker, MinIO, and In-Memory Catalogs for CI

   Local Iceberg development environments: in-process catalogs, a Docker Compose stack with MinIO, and CI configurations that run either.

3. September 2, 202631 min read

   Moving Iceberg Tables Between Catalogs Without Rewriting Data

   Why moving Iceberg tables between catalogs is a pointer copy, and the protocol that makes a cutover safe for one table or thousands.

4. August 19, 202638 min read

   Building Lightweight Serverless Ingestion to Apache Iceberg with PyIceberg and DuckDB

   Build lightweight serverless ingestion to Apache Iceberg with PyIceberg and DuckDB, running small feeds in functions that bill for seconds.

5. July 28, 202630 min read

   Building Iceberg Pipelines in Python Without Standing Up Spark

   A large share of production transformations fit comfortably on one machine. PyIceberg, DuckDB, and branch isolation give you a production path that debugs.

6. June 22, 202613 min read

   PyIceberg at Scale Without Apache Spark

   Python-first Iceberg work is useful when it stays honest about what Python should and should not do.

Browse all posts