The Battle of the Compressors: Optimizing Spark Workloads with

Hello! Hope you’re having a wonderful time working with challenging issues around Data and Data Engineering. In this article let’s look at the different compression algorithms Apache Spark offers…

Spark on Scala: Adobe Analytics Reference Architecture, by Adrian Tanase

Spark partitioning: full control. In this post, we'll learn how to…, by Vladimir Prus

Avro vs Parquet. Let's talk about the difference between…, by Park Sehun

Optimizing Apache Spark File Compression with LZ4 or Snappy, by Matthew Salminen

Load Data using EMR Spark with Apache Iceberg, by Vishal Khondre

Advanced Spark Tuning, Optimization, and Performance Techniques, by Garrett R Peternel

Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos

Optimizing genomic data processing on Apache Spark, by Johan Nyström-Persson

The Battle of the Compressors: Optimizing Spark Workloads with ZStd, Snappy and More for Parquet, by Siraj

Bharanidharan muthukumar on LinkedIn: Databricks Certified Associate Developer for Apache Spark 3.0 •…

Easy Guide to Create a Custom Read Data Source in Apache Spark 3, by Amar Gajbhiye

Spark Structured Streaming Deep Dive, by somanath sankaran, Analytics Vidhya

Optimizing Apache Spark File Compression with LZ4 or Snappy, by Matthew Salminen