|
| 1 | +# Kgateway |
| 2 | + |
| 3 | +## Table of Contents |
| 4 | + |
| 5 | +| Extension Version Tested | Profile Tested | Implementation Version | Mode | Report | |
| 6 | +|--------------------------|----------------|------------------------|---------|----------------------------------------------------------------------------| |
| 7 | +| v0.5.1 | Gateway | v2.0.4 | default | [v2.0.4 report](./inference-v2.0.4-report.yaml) | |
| 8 | + |
| 9 | +## Reproduce |
| 10 | + |
| 11 | +This is a mirror of the kgateway [inference conformance GHA workflow](https://github.com/kgateway-dev/kgateway/blob/v2.0.x/.github/actions/kube-inference-extension-conformance-tests/action.yaml). |
| 12 | + |
| 13 | +### Prerequisites |
| 14 | + |
| 15 | +In order to run the conformance tests, the following prerequisites must be met: |
| 16 | + |
| 17 | +- The [kubectl](https://kubernetes.io/docs/tasks/tools/) command-line tool installed and configured for the active cluster context. |
| 18 | +- The [helm](https://github.com/helm/helm), [git](https://git-scm.com/downloads), and [make](https://www.gnu.org/software/make/) command-line tools installed. |
| 19 | + |
| 20 | +### Steps |
| 21 | + |
| 22 | +1. Set the environment variables use by the proceeding steps: |
| 23 | + |
| 24 | + ```sh |
| 25 | + # The kgateway version |
| 26 | + export VERSION=v2.0.4 |
| 27 | + # Skip building and loading the kgateway images |
| 28 | + export SKIP_DOCKER=true |
| 29 | + # Install Gateway API and Inference Extension CRDs |
| 30 | + export CONFORMANCE=true |
| 31 | + ``` |
| 32 | + |
| 33 | +2. Clone the kgateway repository and checkout the release: |
| 34 | + |
| 35 | + ```sh |
| 36 | + git clone -b $VERSION https://github.com/kgateway-dev/kgateway.git && cd kgateway |
| 37 | + ``` |
| 38 | + |
| 39 | +3. Create a KinD cluster: |
| 40 | + |
| 41 | + ```sh |
| 42 | + make kind-setup |
| 43 | + ``` |
| 44 | + |
| 45 | +4. Install the kgateway CRDs: |
| 46 | + |
| 47 | + ```sh |
| 48 | + helm upgrade -i --create-namespace --namespace kgateway-system \ |
| 49 | + --version $VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds |
| 50 | + ``` |
| 51 | + |
| 52 | +5. Install kgateway with Inference Extension enabled: |
| 53 | + |
| 54 | + ```sh |
| 55 | + helm upgrade -i --namespace kgateway-system --version $VERSION \ |
| 56 | + kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway --set inferenceExtension.enabled=true |
| 57 | + ``` |
| 58 | + |
| 59 | +6. Wait for the kgateway rollout to complete: |
| 60 | + |
| 61 | + ```sh |
| 62 | + kubectl rollout status deploy/kgateway -n kgateway-system |
| 63 | + ``` |
| 64 | + |
| 65 | +7. Run the conformance tests: |
| 66 | + |
| 67 | + ```sh |
| 68 | + make gie-conformance |
| 69 | + ``` |
| 70 | + |
| 71 | +8. View and verify the conformance report: |
| 72 | + |
| 73 | + ```sh |
| 74 | + cat _test/conformance/inference-$VERSION-report.yaml |
| 75 | + ``` |
0 commit comments