Topic
data-lake
24 posts tagged “data-lake”.
-
Migrating to Apache Iceberg: Strategies for Every Source System
This is Part 15, the final article of a 15-part Apache Iceberg Masterclass. Part 14 covered hands-on Dremio Cloud. This article covers the three…
-
Hands-On with Apache Iceberg Using Dremio Cloud
This is Part 14 of a 15-part Apache Iceberg Masterclass. Part 13 covered streaming approaches. This article is a practical walkthrough of working…
-
Approaches to Streaming Data into Apache Iceberg Tables
This is Part 13 of a 15-part Apache Iceberg Masterclass. Part 12 covered Python and MPP engines. This article covers the three primary approaches to…
-
Using Apache Iceberg with Python and MPP Query Engines
This is Part 12 of a 15-part Apache Iceberg Masterclass. Part 11 covered metadata tables. This article covers the two main ways to access Iceberg…
-
Apache Iceberg Metadata Tables: Querying the Internals
This is Part 11 of a 15-part Apache Iceberg Masterclass. Part 10 covered maintenance operations. This article covers the metadata tables that let you…
-
Maintaining Apache Iceberg Tables: Compaction, Expiry, and Cleanup
This is Part 10 of a 15-part Apache Iceberg Masterclass. Part 9 covered how tables degrade. This article covers the four maintenance operations that…
-
How Data Lake Table Storage Degrades Over Time
This is Part 9 of a 15-part Apache Iceberg Masterclass. Part 8 covered embedded catalogs. This article explains the five ways Iceberg table storage…
-
When Catalogs Are Embedded in Storage
This is Part 8 of a 15-part Apache Iceberg Masterclass. Part 7 covered the traditional catalog landscape. This article examines a newer approach:…
-
What Are Lakehouse Catalogs? The Role of Catalogs in Apache Iceberg
This is Part 7 of a 15-part Apache Iceberg Masterclass. Part 6 covered the write process and explained how the catalog enables atomic commits. This…
-
Writing to an Apache Iceberg Table: How Commits and ACID Actually Work
This is Part 6 of a 15-part Apache Iceberg Masterclass. Part 5 covered hidden partitioning. This article walks through the exact steps an engine…
-
Hidden Partitioning: How Iceberg Eliminates Accidental Full Table Scans
This is Part 5 of a 15-part Apache Iceberg Masterclass. Part 4 covered partition evolution. This article covers hidden partitioning, the feature that…
-
Partition Evolution: Change Your Partitioning Without Rewriting Data
This is Part 4 of a 15-part Apache Iceberg Masterclass. Part 3 covered metadata-driven performance. This article explains how Iceberg handles the…
-
Performance and Apache Iceberg's Metadata
This is Part 3 of a 15-part Apache Iceberg Masterclass. Part 2 covered the metadata structures of all five table formats. This article focuses on…
-
The Metadata Structure of Modern Table Formats
This is Part 2 of a 15-part Apache Iceberg Masterclass. Part 1 covered why table formats exist. This article breaks down exactly how each format…
-
What Are Table Formats and Why Were They Needed?
This is Part 1 of a 15-part Apache Iceberg Masterclass. This article covers the fundamental question: what problem do table formats solve, and why…
-
Introduction to ANSI SQL - Understanding the Syntax and Concepts
Learning the Standard SQL Syntax
-
Introduction to Data Vault Modeling
Understanding the Data Vault Style of Data Warehouse Modeling
-
Table Format FUD - Thinking Through the Table Format Conversion (Apache Iceberg, Apache Hudi, Delta Lake)
Understanding how to choose a table format
-
Embracing the Future of Data Management - Why Choose Lakehouse, Iceberg, and Dremio?
The Future of Data Platforms
-
Open Lakehouse Engineering/Apache Iceberg Lakehouse Engineering - A Directory of Resources
Resources for learning how to Engineer an Open Data Lakehouse
-
Nessie - An Alternative to Hive & JDBC for Self-Managed Apache Iceberg Catalogs
Nessie is the only open-source catalog implementation specifically for Apache Iceberg.
-
Apache Iceberg, Git-Like Catalog Versioning and Data Lakehouse Management - Pillars of a Robust Data Lakehouse Platform
This is where the combined power of Dremio’s Lakehouse Management features and Project Nessie's catalog-level versioning comes into play.
-
5 Reasons Your Data Lakehouse should Embrace Dremio Cloud
How your data lakehouse can expand what's possible with Dremio Cloud.
-
Brief Hands on Intro to Apache Iceberg
Engineer a Data Lakehouse with Apache Iceberg