Getting started with Dask Transcripts
Chapter: Dask under the hood
Lecture: Under the hood checkpoint
Login or
purchase this course
to watch this video and the rest of the course contents.
0:00
Great, now let's do a checkpoint. Why is the scheduler important? The scheduler is a core part of any distributed computing system.
0:20
Amish barn raising is a great metaphor for distributed computing. The scheduler is like the foreman that delegates tasks to all the builders.
0:30
The Dask scheduler takes care of a lot of things, including task stream optimization, data locality,
0:37
and it is constantly being improved by world class experts.