Skip to content

Commit b11b8db

Browse files
authored
Update caching.mdx
trying to make sure it's clear cache is only for identical requests
1 parent f7caff6 commit b11b8db

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/content/docs/ai-gateway/configuration/caching.mdx

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,8 @@ Enable and customize your gateway cache to serve requests directly from Cloudfla
1313

1414
:::note
1515

16-
Currently caching is supported only for text and image responses, and it applies only to identical requests. This is helpful for use cases when there are limited prompt options - for example, a support bot that asks "How can I help you?" and lets the user select an answer from a limited set of options works well with the current caching configuration.
16+
Currently caching is supported only for text and image responses, and it applies only to identical requests.
17+
This is helpful for use cases when there are limited prompt options - for example, a support bot that asks "How can I help you?" and lets the user select an answer from a limited set of options works well with the current caching configuration.
1718
We plan on adding semantic search for caching in the future to improve cache hit rates.
1819
:::
1920

0 commit comments

Comments
 (0)