Skip to content

Commit 7542315

Browse files
authored
Update caching.mdx
1 parent b11b8db commit 7542315

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/content/docs/ai-gateway/configuration/caching.mdx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ Enable and customize your gateway cache to serve requests directly from Cloudfla
1414
:::note
1515

1616
Currently caching is supported only for text and image responses, and it applies only to identical requests.
17+
1718
This is helpful for use cases when there are limited prompt options - for example, a support bot that asks "How can I help you?" and lets the user select an answer from a limited set of options works well with the current caching configuration.
1819
We plan on adding semantic search for caching in the future to improve cache hit rates.
1920
:::

0 commit comments

Comments
 (0)