Skip to content

Commit 337eb69

Browse files
authored
docs: add Kgateway BBR documentation (kubernetes-sigs#1908)
1 parent d21e975 commit 337eb69

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

site-src/guides/serve-multiple-genai-models.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,30 @@ First install this server. Depending on your Gateway provider, you can use one o
4040
oci://registry.k8s.io/gateway-api-inference-extension/charts/body-based-routing
4141
```
4242

43+
=== "Kgateway"
44+
45+
Kgateway does not require the Body-Based Routing Extension, and instead natively implements Body-Based Routing.
46+
To use Body Based Routing, apply an `AgentgatewayPolicy`:
47+
48+
```yaml
49+
apiVersion: gateway.kgateway.dev/v1alpha1
50+
kind: AgentgatewayPolicy
51+
metadata:
52+
name: bbr
53+
spec:
54+
targetRefs:
55+
- group: gateway.networking.k8s.io
56+
kind: Gateway
57+
name: inference-gateway
58+
traffic:
59+
phase: PreRouting
60+
transformation:
61+
request:
62+
set:
63+
- name: X-Gateway-Model-Name
64+
value: 'json(request.body).model'
65+
```
66+
4367
=== "Other"
4468

4569
```bash

0 commit comments

Comments
 (0)