File tree Expand file tree Collapse file tree 1 file changed +4
-6
lines changed
src/content/docs/ai-gateway/guardrails Expand file tree Collapse file tree 1 file changed +4
-6
lines changed Original file line number Diff line number Diff line change @@ -20,13 +20,11 @@ AI Gateway inspects all interactions in real time by evaluating content against
2020
2121## Supported model types
2222
23- Guardrails determines the type of AI model being used and applies safety checks accordingly:
24-
25- - Text generation models: Both prompts and responses are evaluated.
26- - Embedding models: Only the prompt is evaluated, and the response is passed directly back to the user.
27- - Unknown models: If the model type cannot be determined, prompts are evaluated, but responses bypass Guardrails.
23+ AI Gateway's Guardrails detects the type of AI model being used and applies safety checks accordingly:
2824
29- If Guardrails cannot access the underlying model, requests set to "block" will result in an error, while flagged requests will proceed.
25+ - ** Text generation models** : Both prompts and responses are evaluated.
26+ - ** Embedding models** : Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation.
27+ - ** Unknown models** : If the model type cannot be determined, only the prompt is evaluated, while the response bypass Guardrails.
3028
3129## Configuration
3230
You can’t perform that action at this time.
0 commit comments