quickstart with Istio fails due to wrong order of steps #1649
Description
What happened:
following the quickstart steps with Istio as gateway fails.
more specifically, this step fails:
https://gateway-api-inference-extension.sigs.k8s.io/guides/#deploy-the-inferencepool-and-endpoint-picker-extension
the reason for this failure is because we recently added DestinationRule creation as part of the helm chart, therefore it's needed to first install Istio CRDs and only then to install the helm chart (otherwise, the resource is not recognized).
output of the helm install command:
Error: INSTALLATION FAILED: unable to build kubernetes objects from release manifest: resource mapping not found for name: "vllm-llama3-8b-instruct-epp" namespace: "" from "": no matches for kind "DestinationRule" in version "networking.istio.io/v1beta1"
What you expected to happen:
quickstart guide should run successfully.
How to reproduce it (as minimally and precisely as possible):
follow quickstart with Istio as gateway.
Anything else we need to know?:
Environment:
- Kubernetes version (use
kubectl version): - Inference extension version (use
git describe --tags --dirty --always): - Cloud provider or hardware configuration:
- Install tools:
- Others: