Building a Custom Agentic Analytics System: Python, LangChain, and SQL Data Lakes
Building your own agentic analytics system is a reasonable choice if you need custom investigation logic, specific tool integrations, or…
The archive
Writing, page 17
546 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
The Death of the Data Swamp: Establishing Governance in Your 2026 Data Lakehouse
A data lake becomes a data swamp when teams stop trusting it. Tables accumulate with no clear owners. Column names mean different things in…
How Apache Iceberg Resolves the Hybrid-Cloud Challenge in Heavily Regulated Markets
Financial institutions in Japan, Germany, and similar regulated markets face a specific architectural problem. Their regulators require…
Securing Apache Iceberg Tables with Fine-Grained Row and Column Level Access Control
Apache Iceberg handles table format, schema evolution, and metadata management. What it doesn't handle is access control. The spec defines…
Designing an Immutable Data Lakehouse: Best Practices for Iceberg Snapshot Expiration
Iceberg tables accumulate snapshots by design. Every write : every INSERT, UPDATE, DELETE, or compaction, creates a new snapshot. That's…
Decoupling Storage and Compute in Apache Iceberg: A Deep Dive into Cost Optimization
Most proprietary data warehouses bundle their storage and compute into a single product. You buy the system, and you get both : at a price…
Legacy Warehouses to Open Lakehouses: A Step-by-Step Migration Playbook
Most teams that start a warehouse-to-lakehouse migration underestimate one thing: the actual problem is trust, not technology. Your…
Building the Brain of the Agentic Lakehouse: Designing an Open Catalog Architecture
An AI agent connected to a data platform needs to know three things before it can answer questions reliably: what data exists, what it…
Evaluating the TCO of an Open Lakehouse vs. Proprietary Data Warehouses
Before you sign a multiyear warehouse contract or commit to building an open lakehouse, you need the actual numbers. Not marketing claims :…
Real-Time BI: Enabling Sub-Second Queries on Apache Iceberg Data Lakehouses
The standard knock on cloud object storage for analytics is latency. S3 GET requests average 20–50 milliseconds each. A dashboard query…