sparklearning

Scheduler

Stories about how Spark schedules work: the DAG Scheduler and the Task Scheduler, and how stages and tasks get submitted and run on executors.

Stories:

• From One Action to Many Tasks
• Locality and Delay Scheduling
• Scheduling Pools and Fair Sharing

Planned stories:

• (More scheduler stories will be added here.)

Stories will be added here gradually.