Skip to content

Commit 27492f5

Browse files
authored
Update caching.mdx (#18311)
* Update caching.mdx trying to make sure it's clear cache is only for identical requests * Update caching.mdx
1 parent f607842 commit 27492f5

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

src/content/docs/ai-gateway/configuration/caching.mdx

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,9 @@ Enable and customize your gateway cache to serve requests directly from Cloudfla
1313

1414
:::note
1515

16-
Currently caching is supported only for text and image responses, and it applies only to identical requests. This is helpful for use cases when there are limited prompt options - for example, a support bot that asks "How can I help you?" and lets the user select an answer from a limited set of options works well with the current caching configuration.
16+
Currently caching is supported only for text and image responses, and it applies only to identical requests.
17+
18+
This is helpful for use cases when there are limited prompt options - for example, a support bot that asks "How can I help you?" and lets the user select an answer from a limited set of options works well with the current caching configuration.
1719
We plan on adding semantic search for caching in the future to improve cache hit rates.
1820
:::
1921

0 commit comments

Comments
 (0)