Skip to content

update custom metadata to explain 5 metadata limit #18359

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Nov 22, 2024
Merged

update custom metadata to explain 5 metadata limit #18359

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
2e56ba5
Update custom-metadata.mdx
kathayl Nov 22, 2024
2274948
Update limits.mdx
kathayl Nov 22, 2024
d0cf36d
Update limits.mdx
kathayl Nov 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions src/content/docs/ai-gateway/configuration/custom-metadata.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,13 @@ Custom metadata in AI Gateway allows you to tag requests with user IDs or other
* **Enhanced Logging**: Metadata appears in your logs, allowing for detailed inspection and troubleshooting.
* **Search and Filter**: Use metadata to efficiently search and filter through logged requests.

:::note


AI Gateway allows you to pass up to five custom metadata entries per request. If more than five entries are provided, only the first five will be saved; additional entries will be ignored. Ensure your custom metadata is limited to five entries to avoid unprocessed or lost data.

:::

## Supported Metadata Types

* String
Expand Down
5 changes: 3 additions & 2 deletions src/content/docs/ai-gateway/reference/limits.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,15 +11,16 @@ The following limits apply to gateway configurations, logs, and related features

| Feature | Limit |
| --------------------------------------------------------------- | ----------------------------------- |
| Cacheable request size | 25 MB per request |
| Custom metadata | 5 entries per request |
| Datasets | 10 per gateway |
| Gateways | 10 per account |
| Gateway name length | 64 characters |
| Logs stored [paid plan](/ai-gateway/reference/pricing/) | 10 million per gateway <sup>1</sup> |
| Logs stored [free plan](/ai-gateway/reference/pricing/) | 100,000 per account <sup>2</sup> |
| Log size stored | 10 MB per log <sup>3</sup> |
| Logpush jobs | 4 per account |
| Logpush size limit | 1MB per log |
| Gateway name length | 64 characters |
| Cacheable request size | 25 MB per request |

<sup>1</sup> If you have reached 10 million logs stored per gateway, new logs
will stop being saved. To continue saving logs, you must delete older logs in
Expand Down
Loading