FIM and Dask Cluster Operator for k8

1. Install the dev cluster of your choice

2. Apply the yaml

kubectl apply -f cluster.yaml

3. Port Forward the dask cluster Scheduler Service

kubectl port-forward svc/simple-scheduler 8786:8786

4. Install uv

curl -LsSf https://astral.sh/uv/install.sh | sh

uv pip compile requirements.in \
   --universal \
   --output-file requirements.txt

5. Create the env

uv venv fim
source fim/bin/activate
uv pip sync requirements.txt

6. Run the script

python fimserv.py

Notes

** The DockerFile is just for creating a custom image for dask with FIMServ ** The cluster.yaml is to create all the needed infra on your local cluster, etc ** Need to make sure that your dev cluster have a storage class.