Agent-Driven Storage Tiering for Apache Iceberg: Moving Cold Data Without Breaking Queries
A five-year-old event table holds 900 terabytes across 3,000 daily partitions. Query logs for the last quarter show that 94 percent of…
Data engineering · Lakehouse · AI
Data Engineering, Lakehouses, and the Future of AI
Alex talks technology, data, software development and AI
593published posts
412topics covered
61+published books
Welcome to my digital garden. This is where I share my deep dives, tutorials, and thoughts on the evolving data landscape.
As the Head of Developer Relations at Dremio and author of Apache Iceberg: The Definitive Guide, Apache Polaris: The Definitive Guide, and Architecting an Apache Iceberg Lakehouse, my mission is to make complex data architectures accessible to everyone.
What You'll Find Here#
- Apache Iceberg & Polaris: Comprehensive guides on open table formats and catalogs.
- Data Lakehouse Architecture: Strategies for building cost-effective, high-performance data platforms.
- AI & RAG: Exploring the intersection of data engineering and Large Language Models.
- Dremio: Tips and tricks for using the Agentic Lakehouse Platform.
Latest writing
All 593 posts →
Securing the Agentic Lakehouse Gateway: Preventing Prompt Injection and Data Exfiltration
A support agent is asked to summarize the last five tickets from a customer. It queries the tickets table through an MCP server connected…
Apache Ossie and Apache Polaris: Putting Semantic Models in the Open Catalog
Ask four systems in the same company what "monthly active users" means and you get four answers. The BI tool counts distinct user IDs with…