Getting started with Dask Transcripts
Chapter: Dask under the hood
Lecture: Under the hood checkpoint

Login or purchase this course to watch this video and the rest of the course contents.
0:00 Great, now let's do a checkpoint. Why is the scheduler important? The scheduler is a core part of any distributed computing system.
0:20 Amish barn raising is a great metaphor for distributed computing. The scheduler is like the foreman that delegates tasks to all the builders.
0:30 The Dask scheduler takes care of a lot of things, including task stream optimization, data locality,
0:37 and it is constantly being improved by world class experts.


Talk Python's Mastodon Michael Kennedy's Mastodon