What Apache Polaris 1.9.0 Brings to Low-Egress Multi-Cloud Catalogs
What Apache Polaris 1.9.0 adds for multi-cloud lakehouses: Cloudflare R2 credential vending, a DynamoDB persistence backend, and the Iceberg 1.12 client.
Data engineering · Lakehouse · AI
Data Engineering, Lakehouses, and the Future of AI
Alex talks technology, data, software development and AI
652published posts
530topics covered
77published books
Welcome to my digital garden. This is where I share my deep dives, tutorials, and thoughts on the evolving data landscape.
As the Head of Developer Relations at Dremio and author of Apache Iceberg: The Definitive Guide, Apache Polaris: The Definitive Guide, and Architecting an Apache Iceberg Lakehouse, my mission is to make complex data architectures accessible to everyone.
What You'll Find Here
- Apache Iceberg & Polaris: Comprehensive guides on open table formats and catalogs.
- Data Lakehouse Architecture: Strategies for building cost-effective, high-performance data platforms.
- AI & RAG: Exploring the intersection of data engineering and Large Language Models.
- Dremio: Tips and tricks for using the Agentic Lakehouse Platform.
Latest writing
All 652 posts →
Schema Pruning and Few-Shot SQL Selection for Data Agents Facing Thousands of Columns
How data agents prune enterprise schemas down to the columns that matter, ground filter values, and pick few-shot SQL examples with the right shape.
Upgrading to Apache Iceberg 1.12.0 Without Breaking Your Engines
A platform engineer's upgrade guide to Apache Iceberg 1.12.0: variant and geospatial changes, REST catalog behavior, removed APIs, and rollback.