Skip to content

Commit 34f6f51

Browse files
author
gitName
committed
restored related policy content
1 parent 6d9c45a commit 34f6f51

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

articles/api-management/azure-openai-api-from-specification.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -141,4 +141,11 @@ To ensure that your Azure OpenAI API is working as expected, test it in the API
141141

142142
:::image type="content" source="media/azure-openai-api-from-specification/api-response-usage.png" alt-text="Screenshot of token usage data in API response in the portal." :::
143143

144+
## Caching policies for Azure OpenAI APIs
145+
146+
In addition to the `azure-openai-token-limit` and `azure-openai-emit-token-metric` policies that you can configure when importing an Azure OpenAI Service API, API Management provides the following caching policies to help you optimize performance and reduce latency for Azure OpenAI APIs:
147+
148+
* `azure-openai-semantic-cache-store`
149+
* `azure-openai-semantic-cache-lookup`
150+
144151
[!INCLUDE [api-management-define-api-topics.md](../../includes/api-management-define-api-topics.md)]

0 commit comments

Comments
 (0)