Dask舵图-如何创建Dask-CUDA-Worker节点

Question

我安装了带有修改过的values.yaml的Dask Helm Chart来拥有10 workers，但是我想创建Dash CUDA Workers来利用我的multi-node集群上的NVIDIA，而不是Dask Workers。

我尝试按如下方式修改values.yaml，以获得Dask CUDA workers而不是Dask Workers，但是worker pod能够启动。我已经按照官方说明在Kubernetes上的所有节点上安装了NVIDIA GPU，所以我不确定DASK需要看到什么才能创建Dask-Cuda-Workers。

worker:
  name: worker
  image:
    repository: "daskdev/dask"
    tag: 2.19.0
    pullPolicy: IfNotPresent
    dask_worker: "dask-cuda-worker"
    #dask_worker: "dask-worker"
    pullSecrets:
    #  - name: regcred
  replicas: 15
  default_resources:  # overwritten by resource limits if they exist
    cpu: 1
    memory: "4GiB"
  env:
  #  - name: EXTRA_APT_PACKAGES
  #    value: build-essential openssl
  #  - name: EXTRA_CONDA_PACKAGES
  #    value: numba xarray -c conda-forge
  #  - name: EXTRA_PIP_PACKAGES
  #    value: s3fs dask-ml --upgrade
  resources: {}
  #  limits:
  #    cpu: 1
  #    memory: 3G
  #    nvidia.com/gpu: 1
  #  requests:
  #    cpu: 1
  #    memory: 3G
  #    nvidia.com/gpu: 1

Answer 1

由于dask-cuda-worker还没有正式出现在dask镜像中，您需要将该镜像拉到一个不同的镜像中：rapidsai/rapidsai:latest