sparklearning

Tungsten

Stories about Spark’s internal binary format and memory layout: why rows are not plain Java objects, and how that helps performance.

Planned stories:

• From Java objects to binary rows (UnsafeRow, whole-stage codegen)
• Off-heap and cache-friendly layout
• How Tungsten ties into shuffle and aggregation

Stories will be added here gradually.