Topic
Iceberg
20 posts tagged “Iceberg”.
-
REST Catalog Credential Vending for Iceberg
Handing a query engine a long-lived cloud storage key so it can read an Iceberg table is one of the most common and most dangerous patterns in…
-
REST Catalog V2: Fixing Iceberg Protocol Debt
A single BI dashboard refresh can trigger dozens of catalog calls before a single byte of table data is scanned. An AI agent investigating a revenue…
-
Zero-Copy Mirroring to Open Iceberg Tables
The most expensive part of moving off a proprietary warehouse is usually not the compute contract. It is the copy. Rewriting terabytes of data into a…
-
Designing Private, Air-Gapped Data Lakehouses: Scaling Iceberg in Highly Secure, On-Premises Clouds
Some of the most important lakehouse work happens in environments that will never look like a simple public-cloud reference architecture. Defense,…
-
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
The table format war is over, and the table formats are not. Both halves of that sentence are true, both matter, and the tension between them is…
-
Migrating to Apache Iceberg: Strategies for Every Source System
This is Part 15, the final article of a 15-part Apache Iceberg Masterclass. Part 14 covered hands-on Dremio Cloud. This article covers the three…
-
Hands-On with Apache Iceberg Using Dremio Cloud
This is Part 14 of a 15-part Apache Iceberg Masterclass. Part 13 covered streaming approaches. This article is a practical walkthrough of working…
-
Approaches to Streaming Data into Apache Iceberg Tables
This is Part 13 of a 15-part Apache Iceberg Masterclass. Part 12 covered Python and MPP engines. This article covers the three primary approaches to…
-
Using Apache Iceberg with Python and MPP Query Engines
This is Part 12 of a 15-part Apache Iceberg Masterclass. Part 11 covered metadata tables. This article covers the two main ways to access Iceberg…
-
Apache Iceberg Metadata Tables: Querying the Internals
This is Part 11 of a 15-part Apache Iceberg Masterclass. Part 10 covered maintenance operations. This article covers the metadata tables that let you…
-
Maintaining Apache Iceberg Tables: Compaction, Expiry, and Cleanup
This is Part 10 of a 15-part Apache Iceberg Masterclass. Part 9 covered how tables degrade. This article covers the four maintenance operations that…
-
How Data Lake Table Storage Degrades Over Time
This is Part 9 of a 15-part Apache Iceberg Masterclass. Part 8 covered embedded catalogs. This article explains the five ways Iceberg table storage…
-
When Catalogs Are Embedded in Storage
This is Part 8 of a 15-part Apache Iceberg Masterclass. Part 7 covered the traditional catalog landscape. This article examines a newer approach:…
-
What Are Lakehouse Catalogs? The Role of Catalogs in Apache Iceberg
This is Part 7 of a 15-part Apache Iceberg Masterclass. Part 6 covered the write process and explained how the catalog enables atomic commits. This…
-
Writing to an Apache Iceberg Table: How Commits and ACID Actually Work
This is Part 6 of a 15-part Apache Iceberg Masterclass. Part 5 covered hidden partitioning. This article walks through the exact steps an engine…
-
Hidden Partitioning: How Iceberg Eliminates Accidental Full Table Scans
This is Part 5 of a 15-part Apache Iceberg Masterclass. Part 4 covered partition evolution. This article covers hidden partitioning, the feature that…
-
Partition Evolution: Change Your Partitioning Without Rewriting Data
This is Part 4 of a 15-part Apache Iceberg Masterclass. Part 3 covered metadata-driven performance. This article explains how Iceberg handles the…
-
Performance and Apache Iceberg's Metadata
This is Part 3 of a 15-part Apache Iceberg Masterclass. Part 2 covered the metadata structures of all five table formats. This article focuses on…
-
The Metadata Structure of Modern Table Formats
This is Part 2 of a 15-part Apache Iceberg Masterclass. Part 1 covered why table formats exist. This article breaks down exactly how each format…
-
What Are Table Formats and Why Were They Needed?
This is Part 1 of a 15-part Apache Iceberg Masterclass. This article covers the fundamental question: what problem do table formats solve, and why…