Batch Pipelines

1. August 2, 202631 min read

   Designing Batch Pipelines That Write Well Into Apache Iceberg

   The pipeline runs at 2 a.m. It reads yesterday's extract, does its transformations, and writes to an Apache Iceberg table. Six months later the same…

Browse all posts