Designing Private, Air-Gapped Data Lakehouses: Scaling Iceberg in Highly Secure, On-Premises Clouds
Some of the most important lakehouse work happens in environments that will never look like a simple public-cloud reference architecture.…
The archive
Writing, page 16
593 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
Migrating Proprietary Warehouses to Open Lakehouses: The 2026 Playbook for Zero-Copy Metadata Translation
Every warehouse migration sounds simpler before the first inventory. Then the team discovers old dashboards, hidden dependencies,…
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
The table format war is over, and the table formats are not. Both halves of that sentence are true, both matter, and the tension between…
Trustworthy Concurrency in the Agentic Lakehouse: Reconciling Academic Proofs with High-Frequency Production Writes
Agentic lakehouses change the concurrency conversation. Traditional data pipelines already deal with overlapping jobs, retries, compaction,…
When Gatekeepers Panic: The Encyclopédie, Open AI Models, and the Politics of Accessible Knowledge
In 1759, Pope Clement XIII ordered the owners of a book to hand their copies to a priest for burning. The penalty for refusal was…
The Who, What, and Why of Semantic Layers: The Layer That Decides Whether Your Numbers Can Be Trusted
There is a survey statistic making the rounds this year that I cannot stop quoting: 84 percent of data teams report regularly encountering…
AI-Ready Metadata Prevents Query Failures
AI-ready metadata reduces query failures by making ownership, freshness, lineage, quality, and policy visible at execution time. For data…
Autonomous Materialization for Agentic Analytics
Autonomous materialization is useful when it is tied to workload evidence, governance checks, and lifecycle management. For platform teams…
Composable Semantic Layers for Analytical Agents
AI agents need more than metric names. They need composable business logic that survives multi-step analysis. For analytics engineers and…
Built for Agents and Managed by Agents
Dremio Agentic Lakehouse is easiest to understand as two ideas: data built for agent access and platform work managed by agents. For Dremio…