Concurrency

1. August 4, 202621 min read

   Surviving Optimistic Commit Collisions When Hundreds of Agents Write to Iceberg

   The read path got all the attention. Agents query tables, a semantic layer keeps them honest, a catalog decides what they can see. That architecture…

2. July 28, 202631 min read

   Surviving Commit Conflicts When Dozens of Writers Hit the Same Iceberg Table

   A compaction job runs for three hours, rewrites 4,000 files, and dies at the last step with CommitFailedException: Cannot commit changes based on…

3. July 13, 202618 min read

   Iceberg Concurrency for AI Agent Writes

   A single autonomous agent can attempt more table commits in an hour than a team of analysts produces in a week. Multiply that by a fleet of agents…

4. July 6, 202615 min read

   Trustworthy Concurrency in the Agentic Lakehouse: Reconciling Academic Proofs with High-Frequency Production Writes

   Agentic lakehouses change the concurrency conversation. Traditional data pipelines already deal with overlapping jobs, retries, compaction, merges,…

Browse all posts