Merge branch 'release-ignite-ai-studio' of https://github.com/MicrosoftDocs/azure-ai-docs-pr into sdg-release-update-code-qs-tutorial

Author: sdgilley

articles/ai-services/language-service/personally-identifiable-information/concepts/conversations-entity-categories.md

@@ -154,8 +154,6 @@ This category contains the following entities:
         Any numeric or alphanumeric identifier that could contain any PII information. 
         Examples:   
             * Case Number 
-            * Driver's license
-            * Medicare Beneficiary Identifier (MBI)
             * Member Number 
             * Ticket number 
             * Bank account number 

articles/ai-services/language-service/whats-new.md

@@ -15,9 +15,17 @@ ms.author: jboback
 
 Azure AI Language is updated on an ongoing basis. To stay up-to-date with recent developments, this article provides you with information about new releases and features.
 
+## November 2024
+
+* [Native document support](native-document-support/use-native-documents.md) is now available in public preview `2024-11-15-preview` without gated preview limitations.
+
+## October 2024
+
+* Custom language service features enable you to deploy your project to multiple [resources within a single region](concepts/custom-features/multi-region-deployment.md) via the API, so that you can use your custom model wherever you need.
+
 ## September 2024
 
-* PII detection now has container support. See more details in the Azure Update post: [Announcing Text PII Redaction Container Release](https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/announcing-text-pii-redaction-container-release/ba-p/4264655).
+* PII detection now has container support. See more details in the Azure Update post: [Announcing Text PII Redaction Container Release](https://techcommunity.microsoft.com/blog/azure-ai-services-blog/announcing-text-pii-redaction-container-release/4264655).
 * Custom sentiment analysis (preview) will be retired on January 10th, 2025. Please transition to other custom model training services, such as custom text classification in Azure AI Language, by that date.  See more details in the Azure Update post: [Retirement: Announcing upcoming retirement of custom sentiment analysis (preview) in Azure AI Language (microsoft.com)](https://azure.microsoft.com/updates/v2/custom-sentiment-analysis-retirement).
 * Custom text analytics for health (preview) will be retired on January 10th, 2025. Please transition to other custom model training services, such as custom named entity recognition in Azure AI Language, by that date.  See more details in the Azure Update post: [Retirement: Announcing upcoming retirement of custom text analytics for health (preview) in Azure AI Language (microsoft.com)](https://azure.microsoft.com/updates/v2/custom-text-analytics-for-health-retirement).
 
@@ -27,7 +35,7 @@ Azure AI Language is updated on an ongoing basis. To stay up-to-date with recent
 
 ## July 2024
 
-* [Conversational PII redaction](https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/announcing-conversational-pii-detection-service-s-general/ba-p/4162881) service in English-language contexts is now Generally Available (GA).
+* [Conversational PII redaction](https://techcommunity.microsoft.com/blog/ai-azure-ai-services-blog/announcing-conversational-pii-detection-service-s-general/4162881) service in English-language contexts is now Generally Available (GA).
 * Conversation Summarization now supports 12 additional languages in preview as listed [here](summarization/language-support.md).
 * Summarization Meeting or Conversation Chapter titles features will now support reduced length to focus on the key topics.
 * Enable support for data augmentation for diacritics to generate variations of training data for diacritic variations used in some natural languages which is especially useful for Germanic and Slavic languages. 

articles/ai-services/openai/includes/gpt-4-turbo.md

@@ -27,6 +27,9 @@ This is the replacement for the following preview models:
 
 - Azure AI specific Vision enhancements integration with GPT-4 Turbo with Vision isn't supported for `gpt-4` **Version:** `turbo-2024-04-09`. This includes Optical Character Recognition (OCR), object grounding, video prompts, and improved handling of your data with images.
 
+> [!IMPORTANT]
+> Vision enhancements preview features including Optical Character Recognition (OCR), object grounding, video prompts will be retired and no longer available once `gpt-4` Version: `vision-preview` is upgraded to `turbo-2024-04-09`. If you are currently relying on any of these preview features, this automatic model upgrade will be a breaking change.
+
 ### GPT-4 Turbo provisioned managed availability
 
 - `gpt-4` **Version:** `turbo-2024-04-09` is available for both standard and provisioned deployments. Currently the provisioned version of this model **doesn't support image/vision inference requests**. Provisioned deployments of this model only accept text input. Standard model deployments accept both text and image/vision inference requests.

articles/ai-services/speech-service/custom-speech-ai-studio.md

@@ -0,0 +1,125 @@
+---
+title: Customize a speech model with fine-tuning in AI Studio
+titleSuffix: Azure AI services
+description: Learn about how to customize a speech model with fine-tuning in AI Studio.
+author: eric-urban
+manager: nitinme
+ms.service: azure-ai-speech
+ms.topic: how-to
+ms.date: 11/19/2024
+ms.author: eur
+#Customer intent: As a developer, I want to learn how to customize a speech model with fine-tuning in AI Studio so that I can deploy a custom model.
+---
+
+# Customize a speech model with fine-tuning in AI Studio
+
+With custom speech, you can enhance speech recognition accuracy for your applications by using a custom model for real-time speech to text, speech translation, and batch transcription. The base model, trained with Microsoft-owned data, handles common spoken language well, but a custom model can improve domain-specific vocabulary and audio conditions by providing text and audio data for training. Additionally, you can train the model with structured text for custom pronunciations, display text formatting, and profanity filtering.
+
+> [!TIP]
+> You can bring your custom speech models from [Speech Studio](https://speech.microsoft.com) to [AI Studio](https://ai.azure.com). In AI Studio, you can pick up where you left off by connecting to your existing Speech resource. For more information about connecting to an existing Speech resource, see [Connect to an existing Speech resource](../../ai-studio/ai-services/connect-ai-services.md#connect-azure-ai-services-after-you-create-a-project).
+
+In [AI Studio](https://ai.azure.com), you create a custom speech model by fine-tuning an Azure AI Speech base model with your own data. You can upload your data, test and train a custom model, compare accuracy between models, and deploy a model to a custom endpoint.
+
+This article shows you how to use fine-tuning in AI Studio to create a custom speech model. For more information about custom speech, see the [custom speech overview](./custom-speech-overview.md) documentation.
+
+## Start fine-tuning a model with your data
+
+In AI Studio, you can fine-tune some Azure AI services models. For example, you can fine-tune a model for custom speech. Each custom model is specific to a [locale](language-support.md?tabs=stt). For example, you might fine-tune a model for English in the United States.
+
+1. Go to your AI Studio project. If you need to create a project, see [Create an AI Studio project](../../ai-studio/how-to/create-projects.md).
+1. Select **Fine-tuning** from the left pane.
+1. Select **AI Service fine-tuning**.
+
+    :::image type="content" source="../../ai-studio/media/ai-services/fine-tune-azure-ai-services.png" alt-text="Screenshot of the page to select fine-tuning of Azure AI Services models." lightbox="../../ai-studio/media/ai-services/fine-tune-azure-ai-services.png":::
+ 
+1. In the wizard, select **Speech to text (speech recognition)** for custom speech. Then select **Next**.
+1. Select the connected service resource that you want to use for fine-tuning. Then select **Next**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-select-connection.png" alt-text="Screenshot of the page to select the connected service resource that you want to use for fine-tuning." lightbox="./media/ai-studio/custom-speech/new-fine-tune-select-connection.png":::
+
+    In this example, we can choose from the following options:
+    - **AI Service**: The Azure AI Services multi-service resource that [came with the AI Studio project](../../ai-studio/ai-services/connect-ai-services.md#connect-azure-ai-services-when-you-create-a-project-for-the-first-time).
+    - **Speech Service**: An Azure AI Speech resource that was [connected after the project was created](../../ai-studio/ai-services/connect-ai-services.md#connect-azure-ai-services-after-you-create-a-project). 
+
+1. Enter a name and description for the fine-tuning job. Then select **Next**.
+1. From the new left menu in the fine-tuning page, select **Manage data** and then select **Add data**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data.png" alt-text="Screenshot of the page with an option to add data to the custom speech project." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data.png":::
+
+1. In the **Add data** wizard, select the type of training data you want to add. In this example, we select **Audio + human-labeled transcript**. Then select **Next**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png" alt-text="Screenshot of the page with an option to select the type of training data you want to add." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png":::
+
+1. On the **Upload your data** page, select local files, Azure Blob Storage, or other shared web locations. Then select **Next**.
+1. Enter a name and description for the data. Then select **Next**.
+1. Review the data and select **Upload**. You're taken back to the **Manage data** page. The status of the data is **Processing**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png" alt-text="Screenshot of the page that shows the status of the data as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png":::
+
+## Train a custom model from your data
+
+1. After the data is processed, select **Train model** from the left menu. Then select **+ Train model**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model.png" alt-text="Screenshot of the page with an option to start training for a custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model.png":::
+
+1. In the **Train a new model** wizard, select the base model that you want to fine-tune. Then select **Next**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png" alt-text="Screenshot of the page with an option to select the base model that you want to fine-tune." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png":::
+
+1. Select the data that you want to use for training. Then select **Next**.
+1. Enter a name and description for the model. Then select **Next**.
+1. Review the settings and select **Train a new model**. You're taken back to the **Train model** page. The status of the data is **Processing**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the training as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png":::
+
+## Test the custom model
+
+1. After the model is trained, select **Test models** from the left menu. Then select **+ Create test**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model.png":::
+
+1. In the **Create a new test** wizard, select the test type. In this example, we select **Evaluate accuracy (Audio + transcript data)**. Then select **Next**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png" alt-text="Screenshot of the page with an option to select the test type." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png":::
+
+1. Select the data that you want to use for testing. Then select **Next**.
+1. Select up to two models to evaluate and compare accuracy. In this example, we select the model that we trained and the base model. Then select **Next**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png":::
+
+1. Enter a name and description for the test. Then select **Next**.
+1. Review the settings and select **Create test**. You're taken back to the **Test models** page. The status of the data is **Processing**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the test as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png":::
+
+1. When the test status is **Succeeded**, you can view the results. Select the test to view the results.
+
+
+## Deploy the custom model
+
+1. After you're satisfied with the test results, select **Deploy models** from the left menu. Then select **+ Deploy model**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png" alt-text="Screenshot of the page with an option to deploy the custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png":::
+
+1. In the **Deploy a new model** wizard, select the model that you want to deploy. 
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png" alt-text="Screenshot of the page with an option to select the model that you want to deploy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png":::
+
+1. Enter a name and description for the deployment. Select the box to agree to the terms of use. Then select **Deploy**.
+
+1. After the deployment status is **Succeeded**, you can view the deployment details. Select the deployment to view the details like the endpoint ID. 
+
+    :::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png" alt-text="Screenshot of the page with an option to select the deployment to view the details like the endpoint ID." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png":::
+
+## View fine-tuned models
+
+You can access your custom speech models and deployments from the **Fine-tuning** page. 
+
+1. Select **Fine-tuning** from the left pane.
+1. Select **AI Service fine-tuning**.
+
+    :::image type="content" source="./media/ai-studio/custom-speech/fine-tune-succeeded-list.png" alt-text="Screenshot of the page where you can view fine-tuned AI services models." lightbox="./media/ai-studio/custom-speech/fine-tune-succeeded-list.png":::
+
+## Related content
+
+- [Custom speech overview](./custom-speech-overview.md)