You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: site-src/guides/index.md
+5-6Lines changed: 5 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -225,9 +225,8 @@ Tooling:
225
225
226
226
=== "Kgateway"
227
227
228
-
[Kgateway](https://kgateway.dev/) recently added support for inference extension as a **technical preview**. This means do not
229
-
run Kgateway with inference extension in production environments. Refer to [Issue 10411](https://github.com/kgateway-dev/kgateway/issues/10411)
230
-
for the list of caveats, supported features, etc.
228
+
[Kgateway](https://kgateway.dev/) added Inference Gateway support as a **technical preview** in the
229
+
[v2.0.0 release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.0.0). InferencePool v1.0.0 is currently supported in the latest [rolling release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.1.0-main), which includes the latest changes but may be unstable until the [v2.1.0 release](https://github.com/kgateway-dev/kgateway/milestone/58) is published.
231
230
232
231
1. Requirements
233
232
@@ -237,7 +236,7 @@ Tooling:
237
236
2. Set the Kgateway version and install the Kgateway CRDs.
[Agentgateway](https://agentgateway.dev/) is a purpose-built proxy designed for AI workloads, and comes with native support for inference routing. Agentgateway integrates with [Kgateway](https://kgateway.dev/) as it's control plane.
276
+
[Agentgateway](https://agentgateway.dev/) is a purpose-built proxy designed for AI workloads, and comes with native support for Inference Gateway. Agentgateway integrates with [Kgateway](https://kgateway.dev/) as it's control plane. InferencePool v1.0.0 is currently supported in the latest [rolling release](https://github.com/kgateway-dev/kgateway/releases/tag/v2.1.0-main), which includes the latest changes but may be unstable until the [v2.1.0 release](https://github.com/kgateway-dev/kgateway/milestone/58) is published.
278
277
279
278
1. Requirements
280
279
@@ -284,7 +283,7 @@ Tooling:
284
283
2. Set the Kgateway version and install the Kgateway CRDs.
Copy file name to clipboardExpand all lines: site-src/implementations/gateways.md
+11-8Lines changed: 11 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,9 +18,13 @@ This project has several implementations that are planned or in progress:
18
18
19
19
## Agentgateway
20
20
21
-
[Agentgateway](https://agentgateway.dev/) is an open source Gateway API implementation focusing on AI use cases, including LLM consumption, LLM serving, agent-to-agent ([A2A](https://a2aproject.github.io/A2A/latest/)), and agent-to-tool ([MCP](https://modelcontextprotocol.io/introduction)). It is the first and only proxy designed specifically for the Kubernetes Gateway API, powered by a high performance and scalable Rust dataplane implementation.
21
+
[Agentgateway](https://agentgateway.dev/) is an open source Gateway API and Inference Gateway
implementation focusing on AI use cases, including LLM consumption, LLM serving, agent-to-agent ([A2A](https://a2aproject.github.io/A2A/latest/)),
24
+
and agent-to-tool ([MCP](https://modelcontextprotocol.io/introduction)). It is the first and only proxy designed specifically for the Kubernetes Gateway API
25
+
that is powered by a high performance and scalable Rust dataplane.
22
26
23
-
Agentgateway comes with native support for Gateway API Inference Extension, powered by the [Kgateway](https://kgateway.dev/) control plane.
27
+
Agentgateway can run independently or can be managed by [Kgateway](https://kgateway.dev/).
24
28
25
29
## Alibaba Cloud Container Service for Kubernetes
26
30
@@ -41,7 +45,6 @@ by [this Issue](https://github.com/AliyunContainerService/ack-gateway-api/issues
gateway that can run [independently](https://gateway-api-inference-extension.sigs.k8s.io/guides/#__tabbed_3_3), as an[Istio waypoint](https://kgateway.dev/blog/extend-istio-ambient-kgateway-waypoint/),
94
-
or within your [llm-d infrastructure](https://github.com/llm-d-incubation/llm-d-infra) to improve accelerator (GPU)
95
-
utilization for AI inference workloads.
94
+
[Kgateway](https://kgateway.dev/) is a Gateway API and Inference Gateway
0 commit comments