Topic
Data Pipelines
2 posts tagged “Data Pipelines”.
-
Designing Batch Pipelines That Write Well Into Apache Iceberg
The pipeline runs at 2 a.m. It reads yesterday's extract, does its transformations, and writes to an Apache Iceberg table. Six months later the same…
-
Building Iceberg Pipelines in Python Without Standing Up Spark
A data scientist has a transformation that takes forty lines of pandas. It reads two Iceberg tables, joins them, applies a scoring function from a…