Zero-Copy Warehouse Modernization: Moving to Apache Iceberg Without Downtime
A practical guide to modernizing a data warehouse to Apache Iceberg without downtime, using federation first, then redirecting new data, then.
The archive
Writing, page 12
657 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
The Plan and the Worker: Two Open Specifications for Agent Harnesses
Two open specifications, the Agentic Graph Specification and the Open Agent Profile, turn agent plans and agent identity into portable, reviewable files.
Apache Arrow Flight and ADBC, and Why Database Connectivity Finally Went Columnar
Arrow Flight and ADBC move database results as columnar data, ending the row-oriented bottleneck between engines and applications. Here's how.
Budgeting for Agentic Analytics When Every Question Costs Something Different
Budgeting for agentic analytics when every question costs something different: token economics, query economics, instrumentation, and the cost controls.
The Five Layers of an Agentic Lakehouse and Where the MCP Server Sits
The five layers of an agentic lakehouse and where the MCP server sits: storage, catalog, semantic layer, MCP gateway, and agent surface, plus identity.
Autonomous Table Optimization When Your Query Workload Stops Being Predictable
Autonomous table optimization when query workloads stop being predictable: observing file layout and query patterns, scoring compaction work, adaptive.
Building Apache Iceberg Lakehouses That Run Without an Internet Connection
How to build an Apache Iceberg lakehouse that runs fully offline: storage, catalog, compute, cross-zone transfer, compliance, and the failure modes that bite.
Wiring Analytical Queries to Transactional APIs in Closed-Loop Decision Agents
Wiring analytical queries to transactional APIs in closed-loop decision agents: conditional writes, sagas with compensations, decision records, and blast.
Surviving Optimistic Commit Collisions When Hundreds of Agents Write to Iceberg
Surviving optimistic commit collisions when hundreds of agents write to Iceberg: which conflicts are real, commit buffers, partitioning, and the patterns.
How Iceberg V3 Deletion Vectors Fixed Merge-on-Read for Streaming Tables
How Iceberg V3 deletion vectors replaced accumulating positional delete files and made merge-on-read viable for streaming and CDC tables.