The Battle of the Compressors: Optimizing Spark Workloads with

Hello! Hope you’re having a wonderful time working with challenging issues around Data and Data Engineering. In this article let’s look at the different compression algorithms Apache Spark offers…

The Battle of the Compressors: Optimizing Spark Workloads with ZStd, Snappy and More for Parquet, by Siraj

Pyspark — save vs. saveToTable. A cautionary tale of side effects that…, by Ivelina Yordanova

Expedite Spark Processing using Parquet Bloom Filter, by Balachandar Paulraj

Spark catalyst optimizer and query optimization, by krishnaprasad k

Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos

Improving Spark job performance while writing Parquet

Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos

A gentle introduction to Apache Arrow with Apache Spark and Pandas, by Antonio Cachuan

PyCon Lithuania on LinkedIn: #pyconlt2024 #apachespark #apacheiceberg

Small File, Large Impact — Addressing the Small File Issue in Spark, by Santosh Kumar Thammineni

Sirajudeen A on LinkedIn: Garbage Collection in Spark: Why it Matters and How to Optimize it for…

Distributed Computing 103: Advanced Techniques and Best Practices, by Siraj

Load Data using EMR Spark with Apache Iceberg, by Vishal Khondre

Announcing: Spark Performance Advisor, by Vladimir Prus

Optimizing genomic data processing on Apache Spark, by Johan Nyström-Persson