generated from kubernetes/kubernetes-template-project
-
Notifications
You must be signed in to change notification settings - Fork 176
Open
Labels
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.
Description
What happened:
following the quickstart steps with Istio as gateway fails.
more specifically, this step fails:
https://gateway-api-inference-extension.sigs.k8s.io/guides/#deploy-the-inferencepool-and-endpoint-picker-extension
the reason for this failure is because we recently added DestinationRule creation as part of the helm chart, therefore it's needed to first install Istio CRDs and only then to install the helm chart (otherwise, the resource is not recognized).
output of the helm install command:
Error: INSTALLATION FAILED: unable to build kubernetes objects from release manifest: resource mapping not found for name: "vllm-llama3-8b-instruct-epp" namespace: "" from "": no matches for kind "DestinationRule" in version "networking.istio.io/v1beta1"
What you expected to happen:
quickstart guide should run successfully.
How to reproduce it (as minimally and precisely as possible):
follow quickstart with Istio as gateway.
Anything else we need to know?:
Environment:
- Kubernetes version (use
kubectl version
): - Inference extension version (use
git describe --tags --dirty --always
): - Cloud provider or hardware configuration:
- Install tools:
- Others:
Metadata
Metadata
Assignees
Labels
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.