The archive
593 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
Latest post
A five-year-old event table holds 900 terabytes across 3,000 daily partitions. Query logs for the last quarter show that 94 percent of scans touch the most recent 90 days. Another 5 percent touch the prior year, mostly…
A support agent is asked to summarize the last five tickets from a customer. It queries the tickets table through an MCP server connected…
Ask four systems in the same company what "monthly active users" means and you get four answers. The BI tool counts distinct user IDs with…
Run a query that returns 50 million rows from a fast analytical engine and watch where the time goes. The engine plans the query in 200…
A Spark job reads a 4 terabyte Apache Iceberg table, filters it down to a week of data, joins it against a dimension table, and aggregates.…
Look at the byte breakdown of a large Parquet table in a lakehouse and two column types dominate out of proportion to their row count. The…
A security audit asks a simple question: who can read the customers.pii table, and when was that last changed? The data platform team opens…
Three agents answer the same question on the same afternoon. A finance agent, asked for last quarter's net revenue, sums completed orders,…
A data engineering team of 30 has adopted Apache Iceberg's branching for everything. Each ingestion stream writes to its own branch. Each…
A global company has analytics data in three places. Its retail arm runs on AWS in Virginia and Frankfurt. An acquisition brought a Google…
Newsletter
Deep dives on Apache Iceberg, lakehouse architecture and applied AI. No spam, unsubscribe anytime.
