Skip to content

Commit e084db4

Browse files
Update docs/howto/features/dask.md
Co-authored-by: Erik Sundell <[email protected]>
1 parent 42a6413 commit e084db4

File tree

1 file changed

+13
-8
lines changed

1 file changed

+13
-8
lines changed

docs/howto/features/dask.md

Lines changed: 13 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -42,14 +42,19 @@ AWS, and we can configure a node group there for the dask pods to run onto.
4242

4343
```
4444
dask_nodes = {
45-
# A not yet fully established policy is being developed about using a single
46-
# node pool, see https://github.com/2i2c-org/infrastructure/issues/2687.
47-
"n2-highmem-16" : {
48-
min : 0,
49-
max : 200,
50-
machine_type : "n2-highmem-16",
51-
},
52-
}
45+
local daskNodes = [
46+
// Node definitions for dask worker nodes. Config here is merged
47+
// with our dask worker node definition, which uses spot instances.
48+
// A `node.kubernetes.io/instance-type label is set to the name of the
49+
// *first* item in instanceDistribution.instanceTypes, to match
50+
// what we do with notebook nodes. Pods can request a particular
51+
// kind of node with a nodeSelector
52+
//
53+
// A not yet fully established policy is being developed about using a single
54+
// node pool, see https://github.com/2i2c-org/infrastructure/issues/2687.
55+
//
56+
{ instancesDistribution+: { instanceTypes: ["r5.4xlarge"] }},
57+
];
5358
```
5459

5560
2. Render the `.jsonnet` file into a `.yaml` file that `eksctl` can use

0 commit comments

Comments
 (0)