Skip to content

Commit 12db9ec

Browse files
committed
Add testing note
1 parent c826589 commit 12db9ec

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/proposals/gateway-inference-extension.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -195,6 +195,8 @@ The Gateway API Inference Extension repository provides [conformance tests](http
195195

196196
At a high level, testing should ensure that traffic can be routed from a client, through NGINX, to the proper inference workload, based on the contents of the request.
197197

198+
For development purposes, the [Getting started guide](https://gateway-api-inference-extension.sigs.k8s.io/guides/) explains how to deploy some sample model servers.
199+
198200
## Security Considerations
199201

200202
If the Endpoint Picker (EPP) supports it, we should use a secure TLS connection. This ensures an encrypted and authenticated communication channel between the NGINX data plane and the EPP. For production environments, an integration with `cert-manager` is likely the best solution, as we recommend this for various other secure channels within the NGF ecosystem. Otherwise, our control plane may have to provision certificates in the default case (similar to NGF's startup `cert-generator` Job).

0 commit comments

Comments
 (0)