From 7025fcc6ca8080cee7e4c2f583f5e13b54d29616 Mon Sep 17 00:00:00 2001 From: daisyfaithauma Date: Mon, 10 Mar 2025 13:25:38 +0000 Subject: [PATCH 1/2] Streaming not supported --- .../docs/ai-gateway/guardrails/supported-model-types.mdx | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx b/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx index a23e11b8ece1202..8e14bb1b34d8460 100644 --- a/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx +++ b/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx @@ -10,3 +10,9 @@ AI Gateway's Guardrails detects the type of AI model being used and applies safe - **Text generation models**: Both prompts and responses are evaluated. - **Embedding models**: Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation. - **Unknown models**: If the model type cannot be determined, only the prompt is evaluated, while the response bypass Guardrails. + +:::note[Note] + +Guardrails does not support streaming. + +::: From a77e23f8444697e5a5b5dde79e71b3d116bf7e3e Mon Sep 17 00:00:00 2001 From: Kathy <153706637+kathayl@users.noreply.github.com> Date: Fri, 21 Mar 2025 08:59:40 -0700 Subject: [PATCH 2/2] Update supported-model-types.mdx slight wording update --- .../docs/ai-gateway/guardrails/supported-model-types.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx b/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx index 8e14bb1b34d8460..17a6e2bc6a61d60 100644 --- a/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx +++ b/src/content/docs/ai-gateway/guardrails/supported-model-types.mdx @@ -13,6 +13,6 @@ AI Gateway's Guardrails detects the type of AI model being used and applies safe :::note[Note] -Guardrails does not support streaming. +Guardrails does not yet support streaming responses. Support for streaming is planned for a future update. :::