How to write a JSON API in Scala with Play from scratch
Create a new directory for your project and navigate to it in your terminal. Create a build.sbt file in the project directory and add the…
The archive
Writing, page 37
560 posts on Apache Iceberg, lakehouse architecture, data engineering and applied AI.
An Approach to Architecting a Lower Cost, Fast and Self-Service Data Lakehouse
There are several goals data architects are perpetually trying to improve upon: Speed: Data Analysts and scientists need data to derive…
Building Full CRUD Rest API's with Flask & FastAPI using PsychoPG2
When it comes to building web applications in the modern era, developers are spoilt for choice with a plethora of frameworks and libraries…
Handling Cross-Origin Cookies with ExpressJS
Data is becoming the cornerstone of modern businesses. As businesses scale, so does their data, and this leads to the need for efficient…
Creating a Local Data Lakehouse using Spark/Minio/Dremio/Nessie
Data is becoming the cornerstone of modern businesses. As businesses scale, so does their data, and this leads to the need for efficient…
Project Nessie: A Look in the Depths
Once upon a time, in the mystical realm of data lakes, there was a growing problem. The inhabitants of this realm, data scientists, and…
Overview of File Encryption Algorithms for Everyone
Welcome to the thrilling world of file encryption! In this blog post, we'll unravel the secrets of file encryption algorithms and why they…
Parquet File Compression for Everyone (zstd, brotli, lz4, gzip, snappy)
You know how when you're packing for a trip, you try to stuff as many clothes as you can into your suitcase without breaking the zipper?…
Dremio and Modern Data Architecture: Data Lakes, Data Lakehouses and Data Mesh
Today it can seem like a buzzword onslaught in the data space with terms like Data Mesh, Data Lakehouse, and many more being thrown out…
What is Nessie and Why as a Data Engineer or Architect you should care?
We need to establish a few things to understand why the open-source data catalog, Project Nessie, matters so much. The amount of data and…