Blog, page 7 | Alex Merced's Data, Dev and AI Blog

Agentic lakehouse gateways face prompt injection and exfiltration through query results. A threat model and defenses for the layer in front of data.

August 25, 202630 min read

Apache Ossie and Polaris put metric definitions in the open catalog. What the spec covers, what Polaris stores, and what is still unfinished.

August 25, 202630 min read

JDBC and ODBC often dominate large-result time. Flight SQL and ADBC keep data columnar from server to client, with Python, Go, and Rust examples.

August 25, 202631 min read

DataFusion Comet 1.0 replaces Spark Iceberg scans with native Rust. What speeds up, what still falls back to the JVM, and how to deploy it.

August 25, 202631 min read

ALP and FSST target Parquet's worst cases: floats and high-cardinality strings. How they work and what they change for Iceberg tables.

August 25, 202631 min read

Put REST catalog RBAC and masking in Git. How to review grants, apply them safely, and keep lakehouse access from drifting.

August 25, 202633 min read

Metric contracts in code let teams test, version, and serve business logic to multi-agent systems without each agent inventing its own SQL.

August 25, 202631 min read

High-throughput Iceberg branch merges need conflict detection and automation. How to reconcile concurrent writes without stalling pipelines.

August 25, 202630 min read

Polaris can catalog Iceberg tables across AWS, Azure, and GCP. Four topologies, credential vending, and the tradeoffs of each design.

August 25, 202631 min read

Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.

August 25, 202631 min read

Writing, page 7