Links

▼
Showing posts with label Apache Spark. Show all posts
Showing posts with label Apache Spark. Show all posts
Wednesday, May 20, 2026

Unlocking Apache Spark Performance: Three Open-Source Tools We Use at CERN

›
Apache Spark is incredibly powerful, but anyone who has worked with it long enough knows the feeling: Why is this job suddenly slower tod...
Wednesday, October 1, 2025

Why I’m Loving Spark 4’s Python Data Source (with Direct Arrow Batches)

›
TL;DR:  Apache Spark 4 lets you build  first-class  data sources in pure Python. If your reader yields  Arrow  RecordBatch  objects, Spark i...
Friday, April 26, 2024

Building an Apache Spark Performance Lab: Tools and Techniques for Spark Optimization

›
Apache Spark is renowned for its speed and efficiency in handling large-scale data processing. However, optimizing Spark to achieve maximum ...
Wednesday, September 27, 2023

Enhancing Apache Spark Performance with Flame Graphs: A Practical Example Using Grafana Pyroscope

›
TL;DR Explore a step-by-step example of troubleshooting Apache Spark job performance using flame graph visualization and profiling. Discove...
Friday, August 11, 2023

Performance Comparison of 5 JDKs on Apache Spark

›
Dive into a comprehensive load-testing exploration using Apache Spark with CPU-intensive workloads. This blog provides a comparative analysi...
Thursday, February 23, 2023

Introduction to Spark APIs for Data Processing

›
Introduction to Apache Spark APIs for Data Processing This is a self-paced and open introduction course to Apache Spark. Theory and demos co...