Skip to content

Commit deccda0

Browse files
authored
Docs: Updates kgateway and agentgateway Implementations for v1.0.0 (#1607)
* WIP: Bump kgateway in quickstart Signed-off-by: Daneyon Hansen <[email protected]> * Docs: Updates kgateway and agentgateway implementations Signed-off-by: Daneyon Hansen <[email protected]> --------- Signed-off-by: Daneyon Hansen <[email protected]>
1 parent 173ad58 commit deccda0

File tree

2 files changed

+16
-14
lines changed

2 files changed

+16
-14
lines changed

site-src/guides/index.md

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -225,9 +225,8 @@ Tooling:
225225

226226
=== "Kgateway"
227227

228-
[Kgateway](https://kgateway.dev/) recently added support for inference extension as a **technical preview**. This means do not
229-
run Kgateway with inference extension in production environments. Refer to [Issue 10411](https://github.com/kgateway-dev/kgateway/issues/10411)
230-
for the list of caveats, supported features, etc.
228+
[Kgateway](https://kgateway.dev/) added Inference Gateway support as a **technical preview** in the
229+
[v2.0.0 release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.0.0). InferencePool v1.0.0 is currently supported in the latest [rolling release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.1.0-main), which includes the latest changes but may be unstable until the [v2.1.0 release](https://github.com/kgateway-dev/kgateway/milestone/58) is published.
231230

232231
1. Requirements
233232

@@ -237,7 +236,7 @@ Tooling:
237236
2. Set the Kgateway version and install the Kgateway CRDs.
238237

239238
```bash
240-
KGTW_VERSION=v2.0.4
239+
KGTW_VERSION=v2.1.0-main
241240
helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
242241
```
243242

@@ -274,7 +273,7 @@ Tooling:
274273

275274
=== "Agentgateway"
276275

277-
[Agentgateway](https://agentgateway.dev/) is a purpose-built proxy designed for AI workloads, and comes with native support for inference routing. Agentgateway integrates with [Kgateway](https://kgateway.dev/) as it's control plane.
276+
[Agentgateway](https://agentgateway.dev/) is a purpose-built proxy designed for AI workloads, and comes with native support for Inference Gateway. Agentgateway integrates with [Kgateway](https://kgateway.dev/) as it's control plane. InferencePool v1.0.0 is currently supported in the latest [rolling release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.1.0-main), which includes the latest changes but may be unstable until the [v2.1.0 release](https://github.com/kgateway-dev/kgateway/milestone/58) is published.
278277

279278
1. Requirements
280279

@@ -284,7 +283,7 @@ Tooling:
284283
2. Set the Kgateway version and install the Kgateway CRDs.
285284

286285
```bash
287-
KGTW_VERSION=v2.0.4
286+
KGTW_VERSION=v2.1.0-main
288287
helm upgrade -i --create-namespace --namespace kgateway-system --version $KGTW_VERSION kgateway-crds oci://cr.kgateway.dev/kgateway-dev/charts/kgateway-crds
289288
```
290289

site-src/implementations/gateways.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,13 @@ This project has several implementations that are planned or in progress:
1818

1919
## Agentgateway
2020

21-
[Agentgateway](https://agentgateway.dev/) is an open source Gateway API implementation focusing on AI use cases, including LLM consumption, LLM serving, agent-to-agent ([A2A](https://a2aproject.github.io/A2A/latest/)), and agent-to-tool ([MCP](https://modelcontextprotocol.io/introduction)). It is the first and only proxy designed specifically for the Kubernetes Gateway API, powered by a high performance and scalable Rust dataplane implementation.
21+
[Agentgateway](https://agentgateway.dev/) is an open source Gateway API and Inference Gateway
22+
[v1.0.0 conformant](https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/conformance/reports/v1.0.0/gateway/kgateway/agentgateway)
23+
implementation focusing on AI use cases, including LLM consumption, LLM serving, agent-to-agent ([A2A](https://a2aproject.github.io/A2A/latest/)),
24+
and agent-to-tool ([MCP](https://modelcontextprotocol.io/introduction)). It is the first and only proxy designed specifically for the Kubernetes Gateway API
25+
that is powered by a high performance and scalable Rust dataplane.
2226

23-
Agentgateway comes with native support for Gateway API Inference Extension, powered by the [Kgateway](https://kgateway.dev/) control plane.
27+
Agentgateway can run independently or can be managed by [Kgateway](https://kgateway.dev/).
2428

2529
## Alibaba Cloud Container Service for Kubernetes
2630

@@ -41,7 +45,6 @@ by [this Issue](https://github.com/AliyunContainerService/ack-gateway-api/issues
4145
[ack-gie]:https://www.alibabacloud.com/help/en/ack/product-overview/ack-gateway-with-inference-extension
4246
[ack-gie-usage]:https://www.alibabacloud.com/help/en/ack/ack-managed-and-ack-dedicated/user-guide/intelligent-routing-and-traffic-management-with-ack-gateway-inference-extension
4347

44-
4548
## Envoy AI Gateway
4649

4750
[Envoy AI Gateway][aigw-home] is an open source project built on top of
@@ -88,8 +91,8 @@ Issue](https://github.com/istio/istio/issues/55768).
8891

8992
## Kgateway
9093

91-
[Kgateway](https://kgateway.dev/) is a Gateway API Inference Extension
92-
[conformant](https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/conformance/reports/v0.5.1/gateway/kgateway)
93-
gateway that can run [independently](https://gateway-api-inference-extension.sigs.k8s.io/guides/#__tabbed_3_3), as an [Istio waypoint](https://kgateway.dev/blog/extend-istio-ambient-kgateway-waypoint/),
94-
or within your [llm-d infrastructure](https://github.com/llm-d-incubation/llm-d-infra) to improve accelerator (GPU)
95-
utilization for AI inference workloads.
94+
[Kgateway](https://kgateway.dev/) is a Gateway API and Inference Gateway
95+
[v1.0.0 conformant](https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/conformance/reports/v1.0.0/gateway/kgateway)
96+
implementation that can run [independently](https://gateway-api-inference-extension.sigs.k8s.io/guides/#__tabbed_3_3), as an
97+
[Istio waypoint](https://kgateway.dev/blog/extend-istio-ambient-kgateway-waypoint/), or within your
98+
[llm-d infrastructure](https://github.com/llm-d-incubation/llm-d-infra) to improve accelerator (GPU) utilization for AI inference workloads.

0 commit comments

Comments
 (0)