Merge branch 'main' into eur/speaker-reco

Author: eric-urban

.openpublishing.publish.config.json

@@ -3,13 +3,14 @@
     {
       "docset_name": "azure-ai",
       "build_source_folder": ".",
+      "build_output_subfolder": "azure-ai",
+      "locale": "en-us",
+      "monikers": [],
+      "moniker_ranges": [],
       "xref_query_tags": [
         "/dotnet",
         "/python"
       ],
-      "build_output_subfolder": "azure-ai",
-      "locale": "en-us",
-      "monikers": [],
       "open_to_public_contributors": true,
       "type_mapping": {
         "Conceptual": "Content",
@@ -172,4 +173,4 @@
   ],
   "branch_target_mapping": {},
   "targets": {}
-}
+}

articles/ai-services/.openpublishing.redirection.ai-services.json

@@ -30,6 +30,11 @@
       "redirect_url": "/azure/ai-services/language-service/conversational-language-understanding/how-to/migrate-from-luis",
       "redirect_document_id": false
     },
+    {
+      "source_path_from_root": "/articles/ai-services/luis/luis-concept-data-conversion.md",
+      "redirect_url": "/azure/ai-services/language-service/conversational-language-understanding/how-to/migrate-from-luis",
+      "redirect_document_id": false
+    },
     {
       "source_path_from_root": "/articles/ai-services/custom-vision-service/update-application-to-3.0-sdk.md",
       "redirect_url": "/azure/ai-services/custom-vision-service/overview",
@@ -410,6 +415,16 @@
       "redirect_url": "/azure/ai-services/speech-service/speaker-recognition-overview",
       "redirect_document_id": false
     },
+    {
+      "source_path_from_root": "/articles/ai-services/speech-service/how-to-recognize-intents-from-speech-csharp.md",
+      "redirect_url": "/azure/ai-services/speech-service/intent-recognition",
+      "redirect_document_id": false
+    },
+    {
+      "source_path_from_root": "/articles/ai-services/speech-service/how-to-custom-speech-continuous-integration-continuous-deployment.md",
+      "redirect_url": "/azure/ai-services/speech-service/how-to-custom-speech-model-and-endpoint-lifecycle",
+      "redirect_document_id": false
+    },
     {
       "source_path_from_root": "/articles/ai-services/anomaly-detector/how-to/postman.md",
       "redirect_url": "/azure/ai-services/anomaly-detector/overview",

articles/ai-services/anomaly-detector/index.yml

@@ -12,7 +12,7 @@ metadata:
   manager: nitinme
   ms.service: azure-ai-anomaly-detector
   ms.topic: landing-page
-  ms.date: 01/18/2024
+  ms.date: 09/20/2024
   ms.author: mbullwin
 
 

articles/ai-services/anomaly-detector/overview.md

@@ -7,7 +7,7 @@ author: mrbullwinkle
 manager: nitinme
 ms.service: azure-ai-anomaly-detector
 ms.topic: overview
-ms.date: 01/18/2024
+ms.date: 09/20/2024
 ms.author: mbullwin
 keywords: anomaly detection, machine learning, algorithms
 ---

articles/ai-services/content-safety/how-to/improve-performance.md

@@ -0,0 +1,86 @@
+---
+title: "Mitigate false results in Azure AI Content Safety"
+titleSuffix: Azure AI services
+description: Learn techniques to improve the performance of Azure AI Content Safety models by handling false positives and false negatives.
+#services: cognitive-services
+author: PatrickFarley
+manager: nitinme
+ms.service: azure-ai-content-safety
+ms.topic: how-to
+ms.date: 09/18/2024
+ms.author: pafarley
+#customer intent: As a user, I want to improve the performance of Azure AI Content Safety so that I can ensure accurate content moderation.
+---
+
+# Mitigate false results in Azure AI Content Safety
+
+This guide provides a step-by-step process for handling false positives and false negatives from Azure AI Content Safety models. 
+
+False positives are when the system incorrectly flags non-harmful content as harmful; false negatives are when harmful content is not flagged as harmful. Address these instances to ensure the integrity and reliability of your content moderation process, including responsible generative AI deployment.
+
+## Prerequisites
+
+* An Azure subscription - [Create one for free](https://azure.microsoft.com/free/cognitive-services/)
+* Once you have your Azure subscription, <a href="https://aka.ms/acs-create"  title="Create a Content Safety resource"  target="_blank">create a Content Safety resource </a> in the Azure portal to get your key and endpoint. Enter a unique name for your resource, select your subscription, and select a resource group, supported region (see [Region availability](/azure/ai-services/content-safety/overview#region-availability)), and supported pricing tier. Then select **Create**.
+
+## Review and verification
+
+Conduct an initial assessment to confirm that the flagged content is really a false positive or false negative. This can involve: 
+- Checking the context of the flagged content.  
+- Comparing the flagged content against the content safety risk categories and severity definitions:
+    - If you're using content safety in Azure OpenAI, see the [Azure OpenAI content filtering doc](/azure/ai-services/openai/concepts/content-filter).
+    - If you're using the Azure AI Content Safety standalone API, see the [Harm categories doc](/azure/ai-services/content-safety/concepts/harm-categories?tabs=warning) or the [Prompt Shields doc](/azure/ai-services/content-safety/concepts/jailbreak-detection), depending on which API you're using.
+
+## Customize your severity settings
+
+If your assessment confirms that you found a false positive or false negative, you can try customizing your severity settings to mitigate the issue. The settings depend on which platform you're using.
+
+#### [Content Safety standalone API](#tab/standalone-api)
+
+If you're using the Azure AI Content Safety standalone API directly, try experimenting by setting the severity threshold at different levels for [harm categories](/azure/ai-services/content-safety/concepts/harm-categories?tabs=definitions) based on API output. Alternatively, if you prefer the no-code approach, you can try out those settings in [Content Safety Studio](https://contentsafety.cognitive.azure.com/) or Azure AI Studio’s [Content Safety page](https://ai.azure.com/explore/contentsafety). Instructions can be found [here](/azure/ai-studio/quickstarts/content-safety?tabs=moderate-text-content). 
+
+In addition to adjusting the severity levels for false negatives, you can also use blocklists. More information on using blocklists for text moderation can be found in [Use blocklists for text moderation](/azure/ai-services/content-safety/how-to/use-blocklist?tabs=windows%2Crest).
+
+
+#### [Azure OpenAI](#tab/azure-openai-studio)
+
+Read the [Configurability](/en-us/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cuser-prompt%2Cpython-new#configurability-preview) documentation, as some content filtering configurations may require approval through the process mentioned there.
+
+Follow the steps in the documentation to update configurations to handle false positives or negatives: [How to use content filters (preview) with Azure OpenAI Service](/azure/ai-services/openai/how-to/content-filters). 
+
+In addition to adjusting the severity levels for false negatives, you can also use blocklists. Detailed instruction can be found in [How to use blocklists with Azure OpenAI Service](/azure/ai-services/openai/how-to/use-blocklists).
+
+#### [Azure AI Studio](#tab/azure-ai-studio)
+
+Read the [Configurability](/azure/ai-studio/concepts/content-filtering#configurability-preview) documentation, as some content filtering configurations may require approval through the process mentioned there.
+
+Follow the steps in the documentation to update configurations to handle false positives or negatives: [Azure AI Studio content filtering](/azure/ai-studio/concepts/content-filtering#create-a-content-filter).
+
+In addition to adjusting the severity levels for false negatives, you can also use blocklists. Detailed instruction can be found in [Azure AI Studio content filtering](/azure/ai-studio/concepts/content-filtering#use-a-blocklist-as-a-filter).
+
+---
+
+## Create a custom category based on your own RAI policy
+
+Sometimes you might need to create a custom category to ensure the filtering aligns with your specific Responsible AI policy, as prebuilt categories or content filtering may not be enough. 
+
+Refer to the [Custom categories documentation](/azure/ai-services/content-safety/concepts/custom-categories) to build your own categories with the Azure AI Content Safety API.
+
+## Document issues and send feedback to Azure
+
+If, after you’ve tried all the steps mentioned above, Azure AI Content Safety still can't resolve the false positives or negatives, there is likely a policy definition or model issue that needs further attention.
+
+Document the details of the false positives and/or false negatives by providing the following information to the [Content safety support team](mailto:[email protected]):
+- Description of the flagged content.
+- Context in which the content was posted. 
+- Reason given by Azure AI Content Safety for the flagging (if positive).
+- Explanation of why the content is a false positive or negative.
+- Any adjustments already attempted by adjusting severity settings or using custom categories. 
+- Screenshots or logs of the flagged content and system responses.
+
+This documentation helps in escalating the issue to the appropriate teams for resolution.
+
+## Related content
+
+- [Azure AI Content Safety overview](/azure/ai-services/content-safety/overview)
+- [Harm categories](/azure/ai-services/content-safety/concepts/harm-categories?tabs=warning)

articles/ai-services/content-safety/quickstart-protected-material.md

@@ -73,7 +73,7 @@ curl --location --request POST '<endpoint>/contentsafety/text:detectProtectedMat
 --header 'Ocp-Apim-Subscription-Key: <your_subscription_key>' \
 --header 'Content-Type: application/json' \
 --data-raw '{
-  "text": "to everyone, the best things in life are free. the stars belong to everyone, they gleam there for you and me. the flowers in spring, the robins that sing, the sunbeams that shine"
+  "text": "Kiss me out of the bearded barley Nightly beside the green, green grass Swing, swing, swing the spinning step You wear those shoes and I will wear that dress Oh, kiss me beneath the milky twilight Lead me out on the moonlit floor Lift your open hand Strike up the band and make the fireflies dance Silver moon's sparkling So, kiss me Kiss me down by the broken tree house Swing me upon its hanging tire Bring, bring, bring your flowered hat We'll take the trail marked on your father's map."
 }'
 ```
 The below fields must be included in the url:

articles/ai-services/content-safety/toc.yml

@@ -63,6 +63,8 @@ items:
     href: how-to/custom-categories-rapid.md
   - name: Use a blocklist
     href: how-to/use-blocklist.md
+  - name: Mitigate false results
+    href: how-to/improve-performance.md
   - name: Encryption of data at rest
     href: how-to/encrypt-data-at-rest.md
   - name: Migrate from public preview to GA

articles/ai-services/luis/faq.md

@@ -24,10 +24,6 @@ LUIS has several limit areas. The first is the model limit, which controls inten
 
 An authoring resource lets you create, manage, train, test, and publish your applications. A prediction resource lets you query your prediction endpoint beyond the 1,000 requests provided by the authoring resource. See [Authoring and query prediction endpoint keys in LUIS](luis-how-to-azure-subscription.md) to learn about the differences between the authoring key and the prediction runtime key.
 
-## Does LUIS support speech to text?
-
-Yes, [Speech](../speech-service/how-to-recognize-intents-from-speech-csharp.md#luis-and-speech) to text is provided as an integration with LUIS.
-
 ## What are Synonyms and word variations?
 
 LUIS has little or no knowledge of the broader _NLP_ aspects, such as semantic similarity, without explicit identification in examples. For example, the following tokens (words) are three different things until they're used in similar contexts in the examples provided:

articles/ai-services/luis/luis-concept-data-conversion.md

@@ -95,10 +95,6 @@ Use the _kind_, `LUIS`, when filtering resources in the Azure portal.The LUIS qu
 
 [Sentiment analysis integration](how-to/publish.md), which provides sentiment information, is provided without requiring another Azure resource.
 
-### Speech integration
-
-[Speech integration](../speech-service/how-to-recognize-intents-from-speech-csharp.md) provides 1 thousand endpoint requests per unit cost.
-
 [Learn more about pricing.][pricing]
 
 ## Keyboard controls