Apache Spark

1. August 25, 202631 min read

   DataFusion Comet 1.0 and What Native Rust Scans Change for Spark on Iceberg

   DataFusion Comet 1.0 replaces Spark Iceberg scans with native Rust. What speeds up, what still falls back to the JVM, and how to deploy it.

Browse all posts