Topic
Apache Iceberg
147 posts tagged “Apache Iceberg”.
-
Agent-Driven Storage Tiering for Apache Iceberg: Moving Cold Data Without Breaking Queries
A five-year-old event table holds 900 terabytes across 3,000 daily partitions. Query logs for the last quarter show that 94 percent of scans touch…
-
DataFusion Comet 1.0 and What Native Rust Scans Change for Spark on Iceberg
A Spark job reads a 4 terabyte Apache Iceberg table, filters it down to a week of data, joins it against a dimension table, and aggregates. On paper…
-
High-Throughput Branch Merging: Automating Concurrency and Conflict Resolution in Multi-Branch Iceberg Pipelines
A data engineering team of 30 has adopted Apache Iceberg's branching for everything. Each ingestion stream writes to its own branch. Each…
-
Multi-Cloud REST Catalog Topologies: Running Apache Polaris Across AWS, Azure, and GCP
A global company has analytics data in three places. Its retail arm runs on AWS in Virginia and Frankfurt. An acquisition brought a Google Cloud…
-
Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar
Picture a table with 40 million data files. Every one of those files has an entry in a manifest, and every entry carries per-column statistics for…
-
Semantic Layer Federation: One Logical Model Over Data on Three Clouds
A global retailer's revenue dashboard needs four sources. Orders are in an Apache Iceberg table on S3 in Virginia. Customers are in an Iceberg table…
-
Serverless Iceberg Ingestion with PyIceberg and DuckDB: Micro-Batches Without a Spark Cluster
A team has 40 event feeds landing in an object store. Most of them produce a few hundred megabytes an hour. A handful spike to a few gigabytes during…
-
Zero-Copy Warehouse Modernization: Migrating Legacy Databases to Apache Iceberg Without Downtime
The migration plan looked reasonable in the kickoff deck. Extract 4,000 tables from a 15-year-old enterprise warehouse, load them into cloud object…
-
The Hidden Cost of Tiny Iceberg Commits
There is a number in your streaming configuration that is quietly deciding your lakehouse's operational future, and it looks completely innocent: the…
-
Deletion Vectors vs Position Deletes vs Equality Deletes: The Iceberg Delete Story in 2026
Deleting a row from an immutable file is a contradiction, and every table format on object storage is, at bottom, a system for managing that…
-
Iceberg Is Becoming a Library, Not Just a Table Format
Categories in data infrastructure are quieter than features, and more consequential. For eight years, Apache Iceberg belonged to the category "table…
-
Iceberg Is Escaping the JVM: Why Rust, Go, Python and C++ Implementations Matter
The Apache Iceberg release notes I find most interesting in 2026 are not the ones for the main project. They are the ones for the subprojects:…
-
The Iceberg REST Catalog Compatibility Test: One Suite of Operations Every Platform Should Pass
"Supports the Iceberg REST catalog" is the most load-bearing claim in the modern data platform market, and it has no test. Every catalog service,…
-
Iceberg REST Remote Scan Planning Changes More Than Query Performance
Most of the coverage of Apache Iceberg 1.11 treats remote scan planning as a performance feature. The catalog plans the scan instead of the engine,…
-
Iceberg Row Lineage: The Feature AI and CDC Workloads Will Eventually Depend On
Every roundup of Apache Iceberg v3 runs the same order: deletion vectors first, the Variant type second, and then, somewhere in the back half, a…
-
Iceberg v4's Adaptive Metadata Tree, Explained From First Principles
The best way to understand the centerpiece of the Apache Iceberg v4 design effort is not to read the proposal first. It is to earn the proposal:…
-
Why Iceberg v4 Is Really About Making the Cost of Change Proportional to the Change
Read enough of the Apache Iceberg v4 proposals, the design documents, the dev-list threads, the community sync notes, and a pattern emerges that no…
-
The Catalog Can Now Plan Your Iceberg Query: Inside REST Scan Planning
For as long as Apache Iceberg has existed, one division of labor held constant: catalogs answered "where is the table," and engines figured out…
-
Can Seven Different Iceberg REST Catalogs Really Run the Same DuckDB Code?
A question has been making the rounds in lakehouse circles this year, usually phrased with some disbelief: someone points DuckDB, the in-process…
-
Stop Flattening Your JSON: How Iceberg Variant Changes Semi-Structured Analytics
Somewhere in your company there is a table with a column named payload, properties, rawevent, or extra, and inside it lives JSON stored as a string.…
-
What Actually Happens When Two Engines Write the Same Iceberg Table at Once?
Somewhere in your platform, right now, a Spark job and a streaming writer are heading toward the same Apache Iceberg table, and they will arrive…
-
Variant Shredding Explained: How Iceberg Gets Columnar Performance From Messy JSON
The Variant type in Apache Iceberg v3 gets described in one sentence so often that the sentence has started doing damage: "store JSON without a…
-
Who Actually Owns an Iceberg Table? Managed, External, and the New Vocabulary of Lakehouse Control
Two architects are arguing in a design review about whether to use "managed" Iceberg tables, and the argument is unresolvable, because they are using…
-
Mastering Apache Iceberg v3 Deletion Vectors for High-Throughput Streaming Ingest
Here is a bill that surprises teams every quarter. A Flink pipeline streams change data capture events into an Apache Iceberg table, a few thousand…
-
Goal-Directed Data Quality Agents: Anomaly Quarantine on Apache Iceberg
Every data platform has a quality system, and most of them are the same system: a few hundred rules, written after incidents, checking the failures…
-
Policy-Aware Lakehouse Telemetry: Building Auditable AI Records on Apache Iceberg for the EU AI Act Era
Every article in my agentic lakehouse series has quietly assumed a plane that sees everything: the catalog's audit stream, the semantic layer's…
-
Write-Audit-Publish with Apache Iceberg Branches: CI/CD for Your Data
Software engineering solved its most important quality problem decades ago with a single structural idea, applied everywhere and questioned nowhere:…
-
Zero-Copy Warehouse Modernization: Moving to Apache Iceberg Without Downtime
Warehouse migrations have a reputation, and the reputation is earned. The classic project copies everything: export the tables, rebuild the schemas,…
-
Budgeting for Agentic Analytics When Every Question Costs Something Different
The pilot ran for six weeks with forty users and cost less than a team lunch. Someone approved rolling it out to eight hundred people. The first full…
-
The Five Layers of an Agentic Lakehouse and Where the MCP Server Sits
Someone on your team connects an AI desktop client to a query engine, asks a question about last quarter, and gets an answer in fifteen seconds. It…
-
Autonomous Table Optimization When Your Query Workload Stops Being Predictable
Table maintenance used to be a scheduling problem. You knew which tables were hot, you knew that dashboards filtered on order date and region, and…
-
Building Apache Iceberg Lakehouses That Run Without an Internet Connection
A hospital system wants a lakehouse. Their security review says patient data never leaves facilities they control. A defense contractor wants the…
-
Wiring Analytical Queries to Transactional APIs in Closed-Loop Decision Agents
An agent reads a table, decides something, and calls an API that changes the world. That sentence contains a distributed systems problem that most…
-
Surviving Optimistic Commit Collisions When Hundreds of Agents Write to Iceberg
The read path got all the attention. Agents query tables, a semantic layer keeps them honest, a catalog decides what they can see. That architecture…
-
How Iceberg V3 Deletion Vectors Fixed Merge-on-Read for Streaming Tables
A change data capture pipeline lands updates from an operational database every thirty seconds. Under Iceberg V2 with merge-on-read, each of those…
-
How Iceberg V3 Variant Shredding Changed Semi-Structured Data on S3 Tables
Every data engineer has inherited the same table. It has four or five real columns and one column called payload, raw, body, or eventjson. That…
-
Reading the Apache Iceberg V4 Proposals Before They Land
A Flink job commits every five seconds. Each commit writes one small Parquet file. It also writes a manifest, rewrites a manifest list, and writes a…
-
Building an Honest TCO Model for Open Lakehouses and Proprietary Warehouses
Someone in finance forwards the cloud data warehouse invoice with a one-line question: why is this number growing faster than our data. An architect…
-
Moving From Supply Chain Dashboards to Decision Loops With the Model Context Protocol
A supply chain control tower shows a red tile. A supplier's on-time delivery rate dropped below threshold four days ago. The tile has been red for…
-
Cross-Cloud Credential Vending in Apache Polaris and the End of Permanent Storage Keys
Pull up the configuration for any Spark cluster that reads a data lake and look for the storage credentials. In most organizations you find an IAM…
-
Designing Policy-Aware Telemetry Tables for AI Systems in Apache Iceberg
Two days ago, on August 2, 2026, the EU AI Act's Article 50 transparency obligations came into application. Many teams had that date circled for a…
-
How the Iceberg REST Catalog Turned Into the Lakehouse Control Plane
A dbt run updates a fact table and two dimension tables. The fact table commit succeeds. The second dimension commit fails on a conflict. For the…
-
A Migration Playbook for Moving Legacy Warehouses onto Apache Iceberg
The migration plan says twelve weeks. Week fourteen arrives and the team has moved four tables out of six hundred, because table number five turned…
-
What Zero-Copy Data Sharing Actually Does Between Salesforce, Snowflake, and Databricks
A customer abandons a cart at 8 PM. That event lands in a warehouse table. A marketing platform needs it to trigger a journey, and a service platform…
-
Apache Polaris 1.7.0 and the Quiet Work of Making a Catalog Trustworthy
A Spark job commits a table update. The catalog writes the change to Postgres. Then the network drops between the catalog and the client, and the…
-
Designing Batch Pipelines That Write Well Into Apache Iceberg
The pipeline runs at 2 a.m. It reads yesterday's extract, does its transformations, and writes to an Apache Iceberg table. Six months later the same…
-
Apache Iceberg Support Across the Major Hyperscalers
Every few weeks I get a version of the same question. A team has standardized on Apache Iceberg, they run most of their workloads on one cloud, and…
-
Building Agent Telemetry Tables in Iceberg That Survive an Audit
An agent gives a customer-facing team a revenue number. Six weeks later someone asks where it came from. The application logs rolled off after 14…
-
What Agentic Analytics Actually Costs, and How to Keep It Bounded
A data platform team gets a question from finance in month four of an agent rollout. The engine bill is up 38 percent and the model provider invoice…
-
Running an Apache Iceberg Lakehouse With No Internet Connection
An engineer runs pip install pyiceberg on a classified network and it fails. There is no PyPI. There is no Maven Central, no Docker Hub, no GitHub.…
-
When the Query Optimizer Starts Managing Its Own Materializations
A data engineer maintains 60 materialized views. Twelve of them accelerate queries nobody runs anymore, because the dashboard they served got retired…
-
Why AI Agents Fail on Raw Data, and What to Give Them Instead
An analytics agent gets read access to the data lake. Someone asks it for last quarter's revenue by region. It finds a table named factorders, writes…
-
Why Iceberg V4 Wants to Retire Equality Deletes, and What Streaming Teams Should Do About It
A Flink job writes upserts into an Apache Iceberg table at a few thousand rows per second. The write side looks healthy. Checkpoints land on time,…
-
The Five Layers Between Your Lakehouse and a Trustworthy Agent
An organization ships an analytics agent. It has access to the warehouse, a good model, and a well-written system prompt. Three weeks in, it has…
-
Apache Fluss and Kafka Solve Different Problems in an Iceberg Pipeline
A streaming team is asked to cut dashboard latency from six minutes to under thirty seconds. The pipeline is Kafka into Flink into Apache Iceberg,…
-
Serving Sub-Second Queries Over an Iceberg Lakehouse With a Hot Tier
A fraud detection agent evaluates a transaction. It needs the customer's activity over the last four hours, their ninety-day baseline, and the…
-
Surviving Commit Conflicts When Dozens of Writers Hit the Same Iceberg Table
A compaction job runs for three hours, rewrites 4,000 files, and dies at the last step with CommitFailedException: Cannot commit changes based on…
-
The Jackson 3 Problem in Apache Iceberg, and What It Means for Your Code
A team upgrades to Spring Boot 4. The build breaks in a place nobody expected: a service that reads Iceberg table metadata through iceberg-core.…
-
Wiring an AI Agent to Apache Polaris with the Model Context Protocol
An engineer opens Cursor, types "what tables do we have in the sales namespace, and which ones have a customerid column," and gets an answer in four…
-
Governing Iceberg Tables Across Regions Without Three Sets of Permissions
An engineer needs to join sales data in eu-west-1 with product data in us-east-1. The sales tables live in a Polaris instance the European team runs.…
-
Federating Oracle With an Open Lakehouse Instead of Migrating It
A team is eighteen months into moving reporting off Oracle. Forty percent of the tables are in Iceberg. The remaining sixty percent are the hard…
-
The Parquet Versioning Problem, and Why Iceberg Cares About It
A Spark job writes a table. A Trino query against the same table fails with a decoding error on one column. Nothing in the Iceberg metadata looks…
-
Building Iceberg Pipelines in Python Without Standing Up Spark
A data scientist has a transformation that takes forty lines of pandas. It reads two Iceberg tables, joins them, applies a scoring function from a…
-
Governing What Agents Cost You
A platform team I spoke with watched their query volume rise 40 times in six weeks. No new dashboards, no new users, no new data sources. What…
-
Freshness Is a Contract, Not a Note on a Dashboard
An inventory agent rerouted a shipment last quarter for a company I spoke with, based on stock levels that were six hours old. The warehouse had…
-
The Apache Iceberg Market in the Middle of 2026
Two years ago the interesting question was whether your data platform supported Apache Iceberg. Today every platform claims it does, and the claim…
-
The Whole Lakehouse Fits on Your Laptop Now
A colleague spent forty minutes last month provisioning a cluster to profile a 90 GB Parquet dataset. Startup, dependency resolution, a permissions…
-
Iceberg's Next Version Depends on Decisions Being Made in Parquet
Follow an Apache Iceberg design discussion about column-level updates long enough and it stops being an Iceberg discussion. The question of whether a…
-
Building a Lakehouse That Stays Inside the Border
A manufacturer in southern Germany asked me a question during an architecture review that I have thought about since. Their data sat in a Frankfurt…
-
Table Maintenance Stopped Being a Product
A team I worked with had a dashboard that loaded in three seconds in January and forty seconds in June. Data volume grew 20 percent over that period.…
-
The Model Class Enterprise Data Teams Are Not Using Yet
A finance team asks which of their 40,000 open invoices will pay late. The data sits in a table with 22 columns: customer, terms, amount, history,…
-
Three Vendors Are Rebuilding the Path From Transaction to Agent
A customer changes their shipping address in your order system at 9:14 a.m. At 9:20 a.m. someone asks an AI agent where that order is going. The…
-
What Zero-Copy Actually Costs
A vendor demo I watched last year ended with a slide that said "no data movement." Thirty seconds earlier, the presenter had run a query joining a…
-
The Breakdown of the Open Lakehouse in 2026: Iceberg, Arrow, Polaris, Parquet, and Ossie, and How to Actually Build One
If you have followed the data world for the past few years, you have heard the phrase "open lakehouse" often enough that it may have started to sound…
-
Iceberg v3 Deletion Vectors and Faster DML
Deleting one row from a data lake used to mean rewriting a whole file. If a 512 MB Parquet file held a million rows and you needed to delete one of…
-
Iceberg Variant Type for AI JSON Data
A single LLM response is not a single value. It carries the generated text, a reasoning trace, one or more tool calls with their arguments, source…
-
Iceberg Concurrency for AI Agent Writes
A single autonomous agent can attempt more table commits in an hour than a team of analysts produces in a week. Multiply that by a fleet of agents…
-
The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter
If you want to know where Apache Iceberg is headed, do not read the press releases. Read the dev mailing list. I say that as someone who reads it…
-
The State of Agentic AI Standards in 2026: MCP, A2A, WebMCP, OSI, and the Protocol Stack Taking Shape
In 2023, an AI agent was a demo. In 2024, it was a framework. In 2025, it was a hundred incompatible frameworks. And in 2026, something genuinely new…
-
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
The most common architecture question I get in 2026 is no longer "should we use Iceberg." That one is settled. The question now is "how fresh can our…
-
Apache Iceberg v4 Roadmap: Adaptive Metadata Trees, Single-File Commits, and the Delta Convergence
Apache Iceberg v4 is not a single feature release. It is a set of architectural proposals: adaptive metadata trees, single-file commits, relative…
-
Lakehouse Context Layers with Atlan and Iceberg v3
The context layer explains what lakehouse data means, which is the part table formats do not solve alone. That is the useful lens for lakehouse…
-
Goal-Directed Analytics Agents on Apache Iceberg
The next step after text-to-SQL is a governed action loop with checks before every external effect. That is the useful lens for goal-directed…
-
Iceberg Remote Signing for Regulated Datasets
Remote signing is the stricter pattern for lakehouse storage security because clients request signed file operations instead of receiving storage…
-
Apache Iceberg v3 Deletion Vectors on Snowflake
Deletion vectors matter because row-level changes should not require a full rewrite of every affected data file. That is the useful lens for Apache…
-
CDC Without Complexity Using Iceberg v3 Row Lineage
Row lineage gives Iceberg a native way to tell incremental consumers which rows changed and when they changed. That is the useful lens for Iceberg v3…
-
The 2026 Guide to Iceberg View Federation
Portable views are the missing logic layer between open tables and multi-engine analytics. That is the useful lens for Iceberg view federation in…
-
Modern Python Tooling for Apache Iceberg
Python has become a practical Iceberg control plane for metadata work, catalog automation, and smaller operational workflows. That is the useful lens…
-
Bidirectional Iceberg Writes with Horizon Catalog
Bidirectional Iceberg interoperability changes managed Iceberg from a read surface into a shared write contract. That is the useful lens for…
-
2025 Year in Review Apache Iceberg, Polaris, Parquet, and Arrow
A look back at key developments in Apache Iceberg, Polaris, Parquet, and Arrow in 2025.
-
Comprehensive Hands-on Walk Through of Dremio Cloud Next Gen (Hands-on with Free Trial)
Walkthrough with the new trial of the Dremio Cloud Platform
-
2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI
A curated guide to mastering Apache Iceberg, data lakehouse architectures, and the emerging field of Agentic AI for data professionals.
-
An Exploration of the Commercial Iceberg Catalog Ecosystem
Dive into the world of commercial Iceberg catalogs and discover how they enhance data lakehouse architectures for modern data engineering.
-
Building a Universal Lakehouse Catalog - Beyond Iceberg Tables
Exploring paths to a universal lakehouse catalog that supports multiple data formats and engines, building on Apache Iceberg's success.
-
Intro to Apache Iceberg with Apache Polaris and Apache Spark
Learn how to leverage Apache Iceberg with Apache Polaris and Apache Spark to build scalable and efficient data lakehouses.
-
The State of Apache Iceberg v4 - October 2025 Edition
What's Coming in Apache Iceberg v4: A Deep Dive into the Future of Open Table Formats
-
The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
-
The 2025 & 2026 Ultimate Guide to the Data Lakehouse and the Data Lakehouse Ecosystem
What is the Data Lakehouse and the Data Lakehouse Ecosystem? This comprehensive guide covers everything you need to know about the Data Lakehouse architecture, open table formats like Apache Iceberg, Delta Lake, Apache Hudi, and Apache Paimon, and the modern data ecosystem that supports them.
-
The Endgame – Building an Autonomous Optimization Pipeline for Apache Iceberg
Learn how to automate compaction, snapshot expiration, and layout optimization in Apache Iceberg using metadata-driven triggers and orchestration tools for a self-healing lakehouse.
-
Managing Large-Scale Optimizations – Parallelism, Checkpointing, and Fail Recovery
Learn how to scale Apache Iceberg table optimizations across large datasets using parallelism, checkpointing, and fail recovery to ensure reliability and performance.
-
Unlocking the Power of Agentic AI with Apache Iceberg and Dremio
Unlocking the Power of Agentic AI with Apache Iceberg and Dremio
-
Hidden Pitfalls – Compaction and Partition Evolution in Apache Iceberg
Partition evolution in Apache Iceberg is a powerful feature, but if not managed carefully, it can introduce fragmentation and impact compaction performance. Learn how to handle it effectively.
-
Using Iceberg Metadata Tables to Determine When Compaction Is Needed
Discover how to use Apache Iceberg's metadata tables to proactively detect small files, bloated manifests, and table fragmentation - so you can trigger compaction only when it's needed.
-
Designing the Ideal Cadence for Compaction and Snapshot Expiration
Learn how to design an effective schedule for compaction and snapshot expiration in Apache Iceberg to balance cost, performance, and data freshness.
-
Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests
Learn how to prevent and clean up metadata bloat in Apache Iceberg by expiring snapshots and rewriting manifests for better performance and manageability.
-
Smarter Data Layout – Sorting and Clustering Iceberg Tables
Improve query performance in Apache Iceberg by organizing your data layout with sorting and Z-order clustering. Learn how to reduce scan cost and improve filter effectiveness.
-
Optimizing Compaction for Streaming Workloads in Apache Iceberg
Learn how to design fast, incremental compaction strategies in Apache Iceberg to support high-throughput streaming pipelines without disrupting freshness or performance.
-
The Basics of Compaction – Bin Packing Your Data for Efficiency
Learn how standard compaction works in Apache Iceberg and why bin packing your data files is essential for maintaining query performance and cost efficiency.
-
The Cost of Neglect – How Apache Iceberg Tables Degrade Without Optimization
Learn how Apache Iceberg tables can degrade over time without optimization and what issues this causes for performance, cost, and governance.
-
The Data Lakehouse - The Benefits and Enhancing Implementation
Understanding the value of a lakehouse and how to get that value faster
-
2025 Comprehensive Guide to Apache Iceberg
What is Apache Iceberg, How it Works, and Why it Matters!
-
When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability
A Guide on when to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability
-
2025 Guide to Architecting an Iceberg Lakehouse
A Comprehensive Guide to Building a Data Lakehouse with Apache Iceberg
-
10 Future Apache Iceberg Developments to Look forward to in 2025
What is cool about Apache Iceberg's Future
-
Deep Dive into Dremio's File-based Auto Ingestion into Apache Iceberg Tables
Auto ingesting data from JSON, CSV, and Parquet files into Apache Iceberg Tables
-
Intro to SQL using Apache Iceberg and Dremio
Intro to SQL using Apache Iceberg and Dremio
-
Dremio, Apache Iceberg and their role in AI-Ready Data
The Role of Dremio and Apache Iceberg in AI-Ready Data
-
Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes
How to get hands-on with Apache Iceberg
-
A Brief Guide to the Governance of Apache Iceberg Tables
Controlling Access to your Apache Iceberg Tables
-
Ultimate Directory of Apache Iceberg Resources
Apache Iceberg Education, Tutorials and more!
-
Understanding Apache Iceberg Delete Files
Continuing the Understand Apache Iceberg series, this article delves into the Manifest, a critical component of Apache Iceberg's architecture.
-
Understanding the Apache Iceberg Manifest
Continuing the Understand Apache Iceberg series, this article delves into the Manifest, a critical component of Apache Iceberg's architecture.
-
Understanding the Apache Iceberg Manifest List (Snapshot)
Continuing the Understand Apache Iceberg series, this article delves into the Manifest List, a critical component of Apache Iceberg's architecture.
-
Understanding Apache Iceberg's Metadata.json
The role and content of the metadata.json
-
What Apache Iceberg REST Catalog is and isn't
Understanding Iceberg Catalog Interoperability
-
Understanding the Polaris Iceberg Catalog and Its Architecture
Learn about the new open source Iceberg Catalog in Town
-
Apache Iceberg Reliability
Why Apache Iceberg Works
-
Video Course - Basics of Lakehouse Engineering - Apache Iceberg, Nessie, Dremio
Introductory Course to Data Engineering for Apache Iceberg Lakehouses
-
Partitioning with Apache Iceberg - A Deep Dive
Benefits of Apache Iceberg Partition Evolution and Hidden Partitioning
-
3 Reasons Data Engineers Should Embrace Apache Iceberg
Benefits of Apache Iceberg
-
Running SQL on your Excel Files From Your Laptop with Dremio
How to run SQL on your Excel files easily
-
A Deep Intro to Apache Iceberg and Resources for Learning More
Learning about Apache Iceberg
-
Understanding the Future of Apache Iceberg Catalogs
Java, Rest and the expanding open lakehouse ecosystem
-
End-to-End Basic Data Engineering Tutorial (Spark, Dremio, Superset)
Ingesting Data and Building BI Dashboards
-
5 Open Source Data Projects You Should Be Following
Apache Iceberg, Apache Arrow, Nessie, Ibis, Substrait
-
5 Reasons Dremio is the Ideal Apache Iceberg Lakehouse Platform
Understanding how catalogs work and which one to choose
-
The Apache Iceberg Lakehouse - The Great Data Equalizer
Disrupting the Snowflake/Databricks status quo
-
10 Reasons to Make Apache Iceberg and Dremio Part of Your Data Lakehouse Strategy
Understanding how catalogs work and which one to choose
-
A deep dive into the concept and world of Apache Iceberg Catalogs
Understanding how catalogs work and which one to choose
-
Partitioning Practices in Apache Hive and Apache Iceberg
Deep Dive in Data Lake Table Partitioning
-
Table Format FUD - Thinking Through the Table Format Conversion (Apache Iceberg, Apache Hudi, Delta Lake)
Understanding how to choose a table format
-
Embracing the Future of Data Management - Why Choose Lakehouse, Iceberg, and Dremio?
The Future of Data Platforms
-
Open Lakehouse Engineering/Apache Iceberg Lakehouse Engineering - A Directory of Resources
Resources for learning how to Engineer an Open Data Lakehouse
-
Nessie - An Alternative to Hive & JDBC for Self-Managed Apache Iceberg Catalogs
Nessie is the only open-source catalog implementation specifically for Apache Iceberg.
-
Apache Iceberg, Git-Like Catalog Versioning and Data Lakehouse Management - Pillars of a Robust Data Lakehouse Platform
This is where the combined power of Dremio’s Lakehouse Management features and Project Nessie's catalog-level versioning comes into play.
-
Why Dremio is a must for Apache Iceberg Data Lakehouses
Why is Dremio so useful for Apache Iceberg data lakehouses
-
Understanding Spark Configurations with Apache Iceberg
How to configure Spark for using Apache Iceberg