Data Quality Tooling Compared: Great Expectations, Soda, dbt Tests, and Anomaly Detection
A revenue dashboard shows a 40 percent drop for yesterday. Every pipeline reported success. Every dbt test passed. The orders table has a…
Data engineering · Lakehouse · AI
Data Engineering, Lakehouses, and the Future of AI
Alex talks technology, data, software development and AI
613published posts
471topics covered
61+published books
Welcome to my digital garden. This is where I share my deep dives, tutorials, and thoughts on the evolving data landscape.
As the Head of Developer Relations at Dremio and author of Apache Iceberg: The Definitive Guide, Apache Polaris: The Definitive Guide, and Architecting an Apache Iceberg Lakehouse, my mission is to make complex data architectures accessible to everyone.
What You'll Find Here#
- Apache Iceberg & Polaris: Comprehensive guides on open table formats and catalogs.
- Data Lakehouse Architecture: Strategies for building cost-effective, high-performance data platforms.
- AI & RAG: Exploring the intersection of data engineering and Large Language Models.
- Dremio: Tips and tricks for using the Agentic Lakehouse Platform.
Latest writing
All 613 posts →
The Data Team of the Agentic Era: Generalists Owning End-to-End Workflows
The standard data team was assembled around a set of scarcities. Writing production pipelines required someone who knew Spark internals, so…
dbt on Iceberg: Incremental Models on Open Tables
A dbt project has a model called fctorders configured as materialized='incremental' with incrementalstrategy='merge' and…