Merge pull request #2940 from sdgilley/sdg-release-foundry-toc

rmca14 · web-flow · commit f4ecd08d81c0 · 2025-02-13T15:03:57.000-08:00
DIRTY PR: merge main into release-foundry-toc
diff --git a/articles/ai-services/anomaly-detector/toc.yml b/articles/ai-services/anomaly-detector/toc.yml
@@ -143,4 +143,4 @@
         - name: Multivariate time-series anomaly detection via graph attention network
           href: https://arxiv.org/abs/2009.02040
         - name: More technical articles ...
-          href: whats-new.md#technical-articles
+          href: whats-new.md#technical-articles
diff --git a/articles/ai-services/openai/gpt-v-quickstart.md b/articles/ai-services/openai/gpt-v-quickstart.md
@@ -1,5 +1,5 @@
 ---
-title: 'Quickstart: Use vision-enabled models with the Azure OpenAI Service'
+title: 'Quickstart: Use vision-enabled chats with the Azure OpenAI Service'
 titleSuffix: Azure OpenAI
 description: Use this article to get started using Azure OpenAI to deploy and use the GPT-4 Turbo with Vision model or other vision-enabled models. 
 services: cognitive-services
@@ -22,6 +22,10 @@ Get started using GPT-4 Turbo with images with the Azure OpenAI Service.
 >
 > The latest vision-capable models are `gpt-4o` and `gpt-4o mini`. These models are in public preview. The latest available GA model is `gpt-4` version `turbo-2024-04-09`.
 
+> [!IMPORTANT]
+> Extra usage fees might apply when using chat completion models with vision functionality.
+
+
 ::: zone pivot="ai-foundry-portal"
 
 [!INCLUDE [Azure AI Foundry portal quickstart](includes/gpt-v-studio.md)]
diff --git a/articles/ai-services/openai/includes/gpt-v-studio.md b/articles/ai-services/openai/includes/gpt-v-studio.md
@@ -1,33 +1,45 @@
 ---
-title: 'Quickstart: Use images in chats with the Azure OpenAI Service'
+title: 'Quickstart: Use vision-enabled chats with the Azure OpenAI Service'
 titleSuffix: Azure OpenAI
 description: Use this article to get started using Azure AI Foundry to deploy and use an image-capable model.
 services: cognitive-services
 manager: nitinme
 ms.service: azure-ai-openai
 ms.topic: include
 ms.custom: references_regions, ignite-2024
-ms.date: 12/05/2024
+ms.date: 01/29/2025
 ---
 
-Start using images in your AI chats with a no-code approach through Azure AI Foundry.
+Use this article to get started using [Azure AI Foundry](https://ai.azure.com) to deploy and test a chat completion model with image understanding. 
+
 
 ## Prerequisites
 
 - An Azure subscription. <a href="https://azure.microsoft.com/free/ai-services" target="_blank">Create one for free</a>.
-- An Azure OpenAI Service resource. For more information about resource creation, see the [resource deployment guide](/azure/ai-services/openai/how-to/create-resource).
+- Once you have your Azure subscription, <a href="/azure/ai-services/openai/how-to/create-resource?pivots=web-portal"  title="Create an Azure OpenAI resource."  target="_blank">create an Azure OpenAI resource </a>.
+ For more information about resource creation, see the [resource deployment guide](/azure/ai-services/openai/how-to/create-resource).
+- An [Azure AI Foundry hub](/azure/ai-studio/how-to/create-azure-ai-resource) with your Azure OpenAI resource added as a connection. 
+
+## Prepare your media
+
+You need an image to complete this quickstart. You can use this sample image or any other image you have available.
+
+:::image type="content" source="/azure/ai-studio/media/quickstarts/multimodal-vision/car-accident.png" alt-text="Photo of a car accident that can be used to complete the quickstart." lightbox="/azure/ai-studio/media/quickstarts/multimodal-vision/car-accident.png":::
 
 ## Go to Azure AI Foundry
 
-Browse to [Azure AI Foundry](https://ai.azure.com/) and sign in with the credentials associated with your Azure OpenAI resource. During or after the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.
+1. Browse to [Azure AI Foundry](https://ai.azure.com/) and sign in with the credentials associated with your Azure OpenAI resource. During or after the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.
+1. Select the hub you'd like to work in.
+1. On the left nav menu, select **Models + endpoints** and select **+ Deploy model**.
+1. Choose an image-capable deployment by selecting model name: **gpt-4o** or **gpt-4o-mini**. In the window that appears, select a name and deployment type. Make sure your Azure OpenAI resource is connected. For more information about model deployment, see the [resource deployment guide](/azure/ai-services/openai/how-to/create-resource).
+1. Select **Deploy**.
+1. Next, select your new model and select **Open in playground**. In the chat playground, the deployment you created should be selected in the **Deployment** dropdown.
 
-Create a project or select an existing one. Navigate to the **Models + endpoints** option on the left, and select **Deploy model**. Choose an image-capable deployment by selecting model name: **gpt-4o** or **gpt-4o-mini**. For more information about model deployment, see the [resource deployment guide](/azure/ai-services/openai/how-to/create-resource).  
 
-Select the new deployment and select **Open in playground**.
 
 ## Playground
 
-From this page, you can quickly iterate and experiment with the model's capabilities. 
+In this chat session, you instruct the assistant to aid you in understanding images that you input.
 
 For general help with assistant setup, chat sessions, settings, and panels, refer to the [Chat quickstart](/azure/ai-services/openai/chatgpt-quickstart?tabs=command-line&pivots=programming-language-studio). 
 
@@ -36,14 +48,50 @@ For general help with assistant setup, chat sessions, settings, and panels, refe
 
 In this chat session, you're instructing the assistant to aid in understanding images that you input. 
 1. To start, make sure your image-capable deployment is selected in the **Deployment** dropdown.
-2. In the **Setup** pane, provide a System Message to guide the assistant. The default System Message is: "You are an AI assistant that helps people find information." You can tailor the System Message to the image or scenario that you're uploading. 
+1. In the context text box on the **Setup** panel, provide this prompt to guide the assistant: `"You're an AI assistant that helps people find information."` Or, you can tailor the prompt to your image or scenario.
 
    > [!NOTE]
     > We recommend you update the System Message to be specific to the task in order to avoid unhelpful responses from the model.
 
-1. Save your changes, and when prompted to confirm updating the system message, select **Continue**.
-1. In the **Chat session** pane, enter a text prompt like "Describe this image," and upload an image with the attachment button. You can use a different text prompt for your use case. Then select **Send**. 
-1. Observe the output provided. Consider asking follow-up questions related to the analysis of your image to learn more.
+1. Select **Apply changes** to save your changes. 
+1. In the chat session pane, select the attachment button and then **Upload image**. Choose your image.
+1. Add the following prompt in the chat field: `Describe this image`, and then select the send icon to submit it.
+1. The send icon is replaced by a stop button. If you select it, the assistant stops processing your request. For this quickstart, let the assistant finish its reply.
+1. The assistant replies with a description of the image.
+1. Ask a follow-up question related to the analysis of your image. You could enter, `"What should I highlight about this image to my insurance company?"`.
+1. You should receive a relevant response similar to what's shown here:
+    ```
+    When reporting the incident to your insurance company, you should highlight the following key points from the image:  
+       
+    1. **Location of Damage**: Clearly state that the front end of the car, particularly the driver's side, is damaged. Mention the crumpled hood, broken front bumper, and the damaged left headlight.  
+       
+    2. **Point of Impact**: Indicate that the car has collided with a guardrail, which may suggest that no other vehicles were involved in the accident.  
+       
+    3. **Condition of the Car**: Note that the damage seems to be concentrated on the front end, and there is no visible damage to the windshield or rear of the car from this perspective.  
+       
+    4. **License Plate Visibility**: Mention that the license plate is intact and can be used for identification purposes.  
+       
+    5. **Environment**: Report that the accident occurred near a roadside with a guardrail, possibly in a rural or semi-rural area, which might help in establishing the accident location and context.  
+       
+    6. **Other Observations**: If there were any other circumstances or details not visible in the image that may have contributed to the accident, such as weather conditions, road conditions, or any other relevant information, be sure to include those as well.  
+       
+    Remember to be factual and descriptive, avoiding speculation about the cause of the accident, as the insurance company will conduct its own investigation.
+    ```
+## View and export code
+
+At any point in the chat session, you can enable the **Show raw JSON** switch at the top of the chat window to see the conversation formatted as JSON. Heres' what it looks like at the beginning of the quickstart chat session:
+
+```json
+[
+	{
+		"role": "system",
+		"content": [
+			"You are an AI assistant that helps people find information."
+		]
+	},
+]
+```
+
 
 
 ## Clean up resources
@@ -52,3 +100,5 @@ If you want to clean up and remove an Azure OpenAI resource, you can delete the
 
 - [Azure portal](../../multi-service-resource.md?pivots=azportal#clean-up-resources)
 - [Azure CLI](../../multi-service-resource.md?pivots=azcli#clean-up-resources)
+
+
diff --git a/articles/ai-studio/.openpublishing.redirection.ai-studio.json b/articles/ai-studio/.openpublishing.redirection.ai-studio.json
@@ -245,6 +245,11 @@
               "redirect_url": "/azure/ai-studio/quickstarts/multimodal-vision",
               "redirect_document_id": false
           },
+          {
+            "source_path_from_root": "/articles/ai-studio/quickstarts/multimodal-vision.md",
+            "redirect_url": "/azure/ai-services/openai/gpt-v-quickstart",
+            "redirect_document_id": false
+          },
           {
             "source_path_from_root": "/articles/ai-studio/reference/reference-model-inference-api.md",
             "redirect_url": "/azure/ai-foundry/model-inference/reference/reference-model-inference-api",
@@ -269,6 +274,16 @@
             "source_path_from_root": "/articles/ai-studio/reference/reference-model-inference-images-embeddings.md",
             "redirect_url": "/azure/ai-foundry/model-inference/reference/reference-model-inference-images-embeddings",
             "redirect_document_id": false
+          },
+          {
+            "source_path_from_root": "/articles/ai-studio/concepts/about-capabilities.md",
+            "redirect_url": "/azure/ai-studio/concepts/what-are-ai-services",
+            "redirect_document_id": false
+          },
+          {
+            "source_path_from_root": "/articles/ai-studio/concepts/related-content.md",
+            "redirect_url": "/azure/ai-studio/concepts/what-are-ai-services",
+            "redirect_document_id": false
           }
     ]
 }
diff --git a/articles/ai-studio/ai-services/how-to/connect-azure-openai.md b/articles/ai-studio/ai-services/how-to/connect-azure-openai.md
@@ -100,7 +100,7 @@ Here are a few guides to help you get started with Azure OpenAI Service playgrou
 - [Quickstart: Use the chat playground](../../quickstarts/get-started-playground.md)
 - [Quickstart: Get started using Azure OpenAI Assistants](../../../ai-services/openai/assistants-quickstart.md?context=/azure/ai-studio/context/context)
 - [Quickstart: Use GPT-4o in the real-time audio playground](../../../ai-services/openai/realtime-audio-quickstart.md?context=/azure/ai-studio/context/context)
-- [Quickstart: Analyze images and video with GPT-4 for Vision in the playground](../../quickstarts/multimodal-vision.md)
+- [Quickstart: Analyze images and video in the chat playground](../../quickstarts/multimodal-vision.md)
 
 Each playground has different model requirements and capabilities. The supported regions vary depending on the model. For more information about model availability per region, see the [Azure OpenAI Service models documentation](../../../ai-services/openai/concepts/models.md).
 
diff --git a/articles/ai-studio/concepts/ai-resources.md b/articles/ai-studio/concepts/ai-resources.md
@@ -128,6 +128,6 @@ In the Azure portal, you can find resources that correspond to your project in A
 
 ## Next steps
 
-- [Quickstart: Analyze images and video with GPT-4 for Vision in the playground](../quickstarts/multimodal-vision.md)
+- [Quickstart: Analyze images and video in the chat playground](../quickstarts/multimodal-vision.md)
 - [Learn more about Azure AI Foundry](../what-is-ai-studio.md)
 - [Learn more about projects](../how-to/create-projects.md)
diff --git a/articles/ai-studio/concepts/what-are-ai-services.md b/articles/ai-studio/concepts/what-are-ai-services.md
@@ -0,0 +1,36 @@
+---
+title: What are AI services?
+description: Learn about the various Azure AI services and their capabilities that you can use in Azure AI Foundry.
+author: sdgilley
+ms.author: sgilley
+ms.service: azure-ai-studio
+ms.topic: concept-article  
+ms.date: 1/30/2025
+
+#CustomerIntent: I want to understand what AI services are and how they can help me build AI solutions.
+---
+
+# What are AI services?
+
+[Azure AI Foundry](../what-is-ai-studio.md) is a comprehensive platform for AI development that provides a wide range of tools and services to help you build AI solutions. You can explore the [model catalog](../how-to/model-catalog-overview.md) to find the right model for your use case. 
+
+[Azure AI services](../../ai-services/what-are-ai-services.md) are a collection of task and general purpose models in Azure AI Foundry. These services are designed to help you build AI solutions quickly and easily, without needing to build and train your own models from scratch. In some cases, you can customize these models to better fit your specific needs. 
+
+> [!TIP]
+> While some articles from each service are available in the [Azure AI Foundry documentation](../ai-services/how-to/connect-ai-services.md), explore each service in more depth in their individual service documentation.
+
+| Service | Description |
+| --- | --- |
+| ![Azure OpenAI Service icon](~/reusable-content/ce-skilling/azure/media/ai-services/azure-openai.svg) [Azure OpenAI](../../ai-services/openai/index.yml) | Perform a wide variety of natural language tasks. |
+| ![Content Safety icon](~/reusable-content/ce-skilling/azure/media/ai-services/content-safety.svg) [Content Safety](../../ai-services/content-safety/index.yml) | An AI service that detects unwanted contents. |
+| ![Content Understanding icon](~/reusable-content/ce-skilling/azure/media/ai-services/content-understanding.svg) [Content Understanding](../../ai-services/content-understanding/index.yml) | Analyze various media content—such as audio, video, text, and images— and transform it into structured, organized, and searchable data for your applications. |
+| ![Document Intelligence icon](~/reusable-content/ce-skilling/azure/media/ai-services/document-intelligence.svg) [Document Intelligence](../../ai-services/document-intelligence/index.yml) | Turn documents into intelligent data-driven solutions. |
+| ![Language icon](~/reusable-content/ce-skilling/azure/media/ai-services/language.svg) [Language](../../ai-services/language-service/index.yml) | Build apps with industry-leading natural language understanding capabilities. |
+| ![Speech icon](~/reusable-content/ce-skilling/azure/media/ai-services/speech.svg) [Speech](../../ai-services/speech-service/index.yml) | Speech to text, text to speech, translation, and speaker recognition. |
+| ![Translator icon](~/reusable-content/ce-skilling/azure/media/ai-services/translator.svg) [Translator](../../ai-services/translator/index.yml) | Use AI-powered translation technology to translate more than 100 in-use, at-risk, and endangered languages and dialects. |
+| ![Vision icon](~/reusable-content/ce-skilling/azure/media/ai-services/vision.svg) [Vision](../../ai-services/computer-vision/index.yml) | Analyze content in images and videos. | 
+
+## Related content
+
+- [Use Azure OpenAI Service in Azure AI Foundry portal](../ai-services/how-to/connect-azure-openai.md)
+- [Use Azure AI services in Azure AI Foundry portal](../ai-services/how-to/connect-ai-services.md)
diff --git a/articles/ai-studio/index.yml b/articles/ai-studio/index.yml
@@ -11,6 +11,7 @@ metadata:
     - copilot-learning-hub
     - ignite-2024
   ms.topic: landing-page
+  manager: scottpolly
   ms.reviewer: sgilley
   ms.author: sgilley
   author: sdgilley
@@ -29,42 +30,38 @@ landingContent:
             url: what-is-ai-studio.md
           - text: Azure OpenAI Service in Azure AI Foundry
             url: azure-openai-in-ai-studio.md
-          - text: Select and deploy models from the catalog
-            url: how-to/model-catalog.md
           - text: Retrieval Augmented Generation (RAG)
             url: concepts/retrieval-augmented-generation.md
           - text: Evaluation and monitoring metrics for generative AI
             url: concepts/evaluation-metrics-built-in.md
-      - linkListType: how-to-guide
-        links:
-          - text: Create a project in Azure AI Foundry portal
-            url: how-to/create-projects.md
-          - text: Get started with prompt flow
-            url: how-to/flow-develop.md
-          - text: Connect to AI services
-            url: ai-services/how-to/connect-ai-services.md
+          - text: Model deployment options
+            url: concepts/deployments-overview.md
+
   # Card
-  - title: 10-minute quickstarts
-    linkLists:
+  - title: Get started
+    linkLists:   
       - linkListType: quickstart
         links:
+          - text: Build a chap app in the playground
+            url: quickstarts/get-started-playground.md
           - text: Build a chat app using the Azure AI SDK
             url: quickstarts/get-started-code.md
-          - text: Use Azure OpenAI Assistants in the playground
-            url: ../ai-services/openai/assistants-quickstart.md?context=/azure/ai-studio/context/context
-          - text: Get started using GPT-4 Turbo with Vision
-            url: quickstarts/multimodal-vision.md
-      - linkListType: tutorial
-        links:
-          - text: Deploy an enterprise chat web app
-            url: tutorials/deploy-chat-web-app.md
 
+      - linkListType: how-to-guide
+        links:
+          - text: Select and deploy models from the catalog
+            url: how-to/model-catalog.md
+          - text: Compare benchmarks across models and datasets
+            url: how-to/benchmark-model-in-catalog.md
+          - text: What is Azure AI Agent service?
+            url: ../ai-services/agents/overview.md?context=/azure/ai-studio/context/context
+      
   # Card
-  - title: Develop apps
+  - title: Azure AI Foundry SDK
     linkLists:
       - linkListType: how-to-guide
         links:
-          - text: Get started with the Azure AI SDKs
+          - text: Get started with the Azure AI Foundry SDKs
             url: how-to/develop/sdk-overview.md
           - text: Work with Azure AI Foundry projects in VS Code
             url: how-to/develop/vscode.md
@@ -73,13 +70,9 @@ landingContent:
         links:
           - text: Build a custom chat app with the Azure AI SDK
             url: tutorials/copilot-sdk-create-resources.md
-
-      - linkListType: concept
-        links:
-          - text: Connections for flows and indexing
-            url: concepts/connections.md
-          - text: Deploy models, flows, and web apps
-            url: concepts/deployments-overview.md
+          - text: Deploy an enterprise chat web app
+            url: tutorials/deploy-chat-web-app.md
+            
       - linkListType: reference
         links:
           - text: Azure AI Foundry SDK
@@ -101,4 +94,4 @@ landingContent:
           - text: Azure Machine Learning
             url: /azure/machine-learning/
           - text: Semantic Kernel
-            url: /semantic-kernel/
+            url: /semantic-kernel/
diff --git a/articles/ai-studio/quickstarts/multimodal-vision.md b/articles/ai-studio/quickstarts/multimodal-vision.md
diff --git a/articles/ai-studio/toc.yml b/articles/ai-studio/toc.yml
diff --git a/articles/search/search-indexer-how-to-access-private-sql.md b/articles/search/search-indexer-how-to-access-private-sql.md
