Performance Optimization Guide
speedStandard Optimizations
align_horizontal_left
Skewed Joins
CommonHandle data imbalance across nodes using salting or map-side joins.
memory
Memory Errors
CriticalResolving OutOfMemory (OOM) exceptions in driver and executor.
Advanced Techniques
shuffle
Shuffle Tuning
High ImpactConfiguring shuffle partitions and spill buffer sizes dynamically.
cell_tower
Broadcast Hints
ImpactfulForce broadcast joins for small tables to prevent network shuffles.