Merge pull request #274689 from mrbullwinkle/mrb_05_08_2024_manage_costs_update

[Azure OpenAI] Supportability update

Author: prmerger-automator[bot]

articles/ai-services/openai/concepts/content-filter.md

@@ -982,7 +982,7 @@ data: [DONE]
 ```
 
 > [!IMPORTANT]
-> When content filtering is triggered for a prompt and a `"status": 400` is received as part of the response there may be a charge for this request as the prompt was evaluated by the service. [Charges will also occur](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/) when a `"status":200` is received with `"finish_reason": "content_filter"`. In this case the prompt did not have any issues, but the completion generated by the model was detected to violate the content filtering rules which results in the completion being filtered.
+> When content filtering is triggered for a prompt and a `"status": 400` is received as part of the response there will be a charge for this request as the prompt was evaluated by the service. [Charges will also occur](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/) when a `"status":200` is received with `"finish_reason": "content_filter"`. In this case the prompt did not have any issues, but the completion generated by the model was detected to violate the content filtering rules which results in the completion being filtered.
 
 ## Best practices
 

articles/ai-services/openai/faq.yml

@@ -113,6 +113,15 @@ sections:
           How do I fix InternalServerError - 500 - Failed to create completion as the model generated invalid Unicode output?
         answer:
           You can minimize the occurrence of these errors by reducing the temperature of your prompts to less than 1 and ensuring you're using a client with retry logic. Reattempting the request often results in a successful response.
+      - question: |
+          We noticed charges associated with API calls that failed to complete with status code 400. Why are failed API calls generating a charge? 
+        answer:
+          If the service performs processing, you will be charged even if the status code is not successful (not 200).
+          Common examples of this are, a 400 error due to a content filter or input limit, or a 408 error due to a timeout. Charges will also occur when a `status 200` is received with a `finish_reason` of `content_filter`.
+          In this case the prompt did not have any issues, but the completion generated by the model was detected to violate the content filtering rules which results in the completion being filtered. 
+
+          If the service doesn't perform processing, you won't be charged.
+          For example, a 401 error due to authentication or a 429 error due to exceeding the Rate Limit.
           
   - name: Getting access to Azure OpenAI Service
     questions:

articles/ai-services/openai/how-to/manage-costs.md

@@ -6,7 +6,7 @@ ms.author: mbullwin
 ms.custom: subject-cost-optimization
 ms.service: azure-ai-openai
 ms.topic: how-to
-ms.date: 08/22/2023
+ms.date: 05/08/2024
 ---
 
 
@@ -69,7 +69,7 @@ You can pay for Azure OpenAI Service charges with your Azure Prepayment credit.
 
 ### HTTP Error response code and billing status in Azure OpenAI Service
 
-If the service performs processing, you may be charged even if the status code is not successful (not 200).
+If the service performs processing, you will be charged even if the status code is not successful (not 200).
 For example, a 400 error due to a content filter or input limit, or a 408 error due to a timeout.
 
 If the service doesn't perform processing, you won't be charged.