Skip to content

Commit 728c906

Browse files
changes to docs
1 parent ba3ab97 commit 728c906

File tree

3 files changed

+36
-8
lines changed

3 files changed

+36
-8
lines changed

src/content/docs/ai-gateway/guardrails/set-up-guardrail.mdx

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,6 @@ sidebar:
55
order: 3
66
---
77

8-
## Supported model types
9-
10-
AI Gateway's Guardrails detects the type of AI model being used and applies safety checks accordingly:
11-
12-
- **Text generation models**: Both prompts and responses are evaluated.
13-
- **Embedding models**: Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation.
14-
- **Unknown models**: If the model type cannot be determined, only the prompt is evaluated, while the response bypass Guardrails.
15-
168
## Configuration
179

1810
Within AI Gateway settings, you can customize Guardrails:
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
pcx_content_type: reference
3+
title: Supported model types
4+
sidebar:
5+
order: 3
6+
---
7+
8+
## Supported model types
9+
10+
AI Gateway's Guardrails detects the type of AI model being used and applies safety checks accordingly:
11+
12+
- **Text generation models**: Both prompts and responses are evaluated.
13+
- **Embedding models**: Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation.
14+
- **Unknown models**: If the model type cannot be determined, only the prompt is evaluated, while the response bypass Guardrails.
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
---
2+
pcx_content_type: reference
3+
title: Supported model types
4+
sidebar:
5+
order: 4
6+
---
7+
8+
## Workers AI and Guardrails
9+
10+
Guardrails currently uses [Llama Guard 3 8B](https://ai.meta.com/research/publications/llama-guard-llm-based-input-output-safeguard-for-human-ai-conversations/) on [Workers AI](/workers-ai/) to perform content evaluations. The underlying model may be updated in the future, and we will reflect those changes within Guardrails.
11+
12+
Since Guardrails runs on Workers AI, enabling it incurs usage on Workers AI. You can monitor usage through the Workers AI Dashboard.
13+
14+
## Additional considerations
15+
16+
- Latency impact: Enabling Guardrails adds some latency. Consider this when balancing safety and speed.
17+
18+
:::note
19+
20+
Llama Guard is provided as-is without any representations, warranties, or guarantees. Any rules or examples contained in blogs, developer docs, or other reference materials are provided for informational purposes only. You acknowledge and understand that you are responsible for the results and outcomes of your use of AI Gateway.
21+
22+
:::

0 commit comments

Comments
 (0)