Skip to content

Commit d93da31

Browse files
daisyfaithaumakathayl
authored andcommitted
[AIG]Streaming not supported (#20670)
* Streaming not supported * Update supported-model-types.mdx slight wording update --------- Co-authored-by: Kathy <[email protected]>
1 parent 888b66d commit d93da31

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

src/content/docs/ai-gateway/guardrails/supported-model-types.mdx

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,9 @@ AI Gateway's Guardrails detects the type of AI model being used and applies safe
1010
- **Text generation models**: Both prompts and responses are evaluated.
1111
- **Embedding models**: Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation.
1212
- **Unknown models**: If the model type cannot be determined, only the prompt is evaluated, while the response bypass Guardrails.
13+
14+
:::note[Note]
15+
16+
Guardrails does not yet support streaming responses. Support for streaming is planned for a future update.
17+
18+
:::

0 commit comments

Comments
 (0)