Merge pull request #266041 from PatrickFarley/comvis-updates

v-dirichards · web-flow · commit 86b455a667e1 · 2024-02-14T15:57:05.000-06:00
Comvis updates
diff --git a/articles/ai-services/computer-vision/how-to/video-retrieval.md b/articles/ai-services/computer-vision/how-to/video-retrieval.md
@@ -1,7 +1,7 @@
 ---
 title: Do video retrieval using vectorization - Image Analysis 4.0
 titleSuffix: Azure AI services
-description: Learn how to call the Spatial Analysis Video Retrieval APIs to vectorize video frames and search terms.
+description: Learn how to call the Video Retrieval APIs to vectorize video frames and search terms.
 #services: cognitive-services
 author: PatrickFarley
 manager: nitinme
@@ -14,7 +14,7 @@ ms.author: pafarley
 
 # Do video retrieval using vectorization (version 4.0 preview)
 
-Azure AI Spatial Analysis Video Retrieval APIs are part of Azure AI Vision and enable developers to create an index, add documents (videos and images) to it, and search with natural language. Developers can define metadata schemas for each index and ingest metadata to the service to help with retrieval. Developers can also specify what features to extract from the index (vision, speech) and filter their search based on features.
+Azure AI Video Retrieval APIs are part of Azure AI Vision and enable developers to create an index, add documents (videos and images) to it, and search with natural language. Developers can define metadata schemas for each index and ingest metadata to the service to help with retrieval. Developers can also specify what features to extract from the index (vision, speech) and filter their search based on features.
 
 ## Prerequisites
 
@@ -24,38 +24,11 @@ Azure AI Spatial Analysis Video Retrieval APIs are part of Azure AI Vision and e
 
 ## Input requirements
 
-### Supported formats
-
-| File format | Description |
-| ----------- | ----------- |
-| `asf`         | ASF (Advanced / Active Streaming Format)       |
-| `avi`         | AVI (Audio Video Interleaved)        |
-| `flv`         | FLV (Flash Video)        |
-| `matroskamm`, `webm`          | Matroska / WebM       |
-| `mov`,`mp4`,`m4a`,`3gp`,`3g2`,`mj2`   | QuickTime / MOV        |
- 
-### Supported video codecs
-
-| Codec       | Format |
-| ----------- | ----------- |
-| `h264`        | H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10       |
-| `h265`        | H.265/HEVC        |
-| `libvpx-vp9`  | libvpx VP9 (codec vp9)        |
-| `mpeg4`       | MPEG-4 part 2       |
- 
-### Supported audio codecs
-
-| Codec       | Format |
-| ----------- | ----------- |
-| `aac`         | AAC (Advanced Audio Coding)       |
-| `mp3`         | MP3 (MPEG audio layer 3)        |
-| `pcm`         | PCM (uncompressed)        |
-| `vorbis`      | Vorbis       |
-| `wmav2`       | Windows Media Audio 2       |
+[!INCLUDE [video-retrieval-input](../includes/video-retrieval-input.md)]
 
 ## Call the Video Retrieval APIs
 
-To use the Spatial Analysis Video Retrieval APIs in a typical pattern, you would do the following steps:
+To use the Video Retrieval APIs in a typical pattern, you would do the following steps:
 
 1. Create an index using **PUT - Create an index**.
 2. Add video documents to the index using **PUT - CreateIngestion**.
@@ -65,7 +38,7 @@ To use the Spatial Analysis Video Retrieval APIs in a typical pattern, you would
 
 ### Use Video Retrieval APIs for metadata-based search
 
-The Spatial Analysis Video Retrieval APIs allows a user to add metadata to video files. Metadata is additional information associated with video files such as "Camera ID," "Timestamp," or "Location" that can be used to organize, filter, and search for specific videos. This example demonstrates how to create an index, add video files with associated metadata, and perform searches using different features.
+The Video Retrieval APIs allows a user to add metadata to video files. Metadata is additional information associated with video files such as "Camera ID," "Timestamp," or "Location" that can be used to organize, filter, and search for specific videos. This example demonstrates how to create an index, add video files with associated metadata, and perform searches using different features.
 
 ### Step 1: Create an Index
 
diff --git a/articles/ai-services/computer-vision/includes/video-retrieval-input.md b/articles/ai-services/computer-vision/includes/video-retrieval-input.md
@@ -0,0 +1,43 @@
+---
+title: "Video Retrieval input requirements"
+titleSuffix: "Azure AI services"
+#services: cognitive-services
+author: PatrickFarley
+manager: nitinme
+ms.service: azure-ai-vision
+ms.custom: 
+ms.topic: include
+ms.date: 02/12/2024
+ms.author: pafarley
+---
+
+
+
+### Supported formats
+
+| File format | Description |
+| ----------- | ----------- |
+| `asf`         | ASF (Advanced / Active Streaming Format)       |
+| `avi`         | AVI (Audio Video Interleaved)        |
+| `flv`         | FLV (Flash Video)        |
+| `matroskamm`, `webm`          | Matroska / WebM       |
+| `mov`,`mp4`,`m4a`,`3gp`,`3g2`,`mj2`   | QuickTime / MOV        |
+ 
+### Supported video codecs
+
+| Codec       | Format |
+| ----------- | ----------- |
+| `h264`        | H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10       |
+| `h265`        | H.265/HEVC        |
+| `libvpx-vp9`  | libvpx VP9 (codec vp9)        |
+| `mpeg4`       | MPEG-4 part 2       |
+ 
+### Supported audio codecs
+
+| Codec       | Format |
+| ----------- | ----------- |
+| `aac`         | AAC (Advanced Audio Coding)       |
+| `mp3`         | MP3 (MPEG audio layer 3)        |
+| `pcm`         | PCM (uncompressed)        |
+| `vorbis`      | Vorbis       |
+| `wmav2`       | Windows Media Audio 2       |
diff --git a/articles/ai-services/computer-vision/index.yml b/articles/ai-services/computer-vision/index.yml
@@ -115,17 +115,20 @@ conceptualContent:
       footerLink:
         text: More
         url: overview-identity.md
-    - title: Spatial Analysis
+    - title: Video Analysis
       links:
         - itemType: overview
-          text: About Spatial Analysis
+          text: About Video Analysis
           url: intro-to-spatial-analysis-public-preview.md
         - itemType: quickstart
           text: Get started with Spatial Analysis
           url: spatial-analysis-container.md
         - itemType: how-to-guide
           text: Configure Spatial Analysis operations
           url: spatial-analysis-operations.md
+        - itemType: how-to-guide
+          text: Call the Video Retrieval APIs
+          url: how-to/video-retrieval.md
         - itemType: concept
           text: Zone and line placement
           url: spatial-analysis-zone-line-placement.md
@@ -137,7 +140,7 @@ conceptualContent:
           url: spatial-analysis-logging.md
       footerLink:
         text: More
-        url: index-spatial-analysis.yml
+        url: intro-to-spatial-analysis-public-preview.md
 
 tools:
   title: Software development kits (SDKs)
diff --git a/articles/ai-services/computer-vision/intro-to-spatial-analysis-public-preview.md b/articles/ai-services/computer-vision/intro-to-spatial-analysis-public-preview.md
@@ -1,33 +1,30 @@
 ---
-title: What is Spatial Analysis?
+title: What is Video Analysis?
 titleSuffix: Azure AI services
-description: This document explains the basic concepts and features of the Azure Spatial Analysis container.
+description: This document explains the basic concepts and features of Azure Spatial Analysis and Video Retrieval.
 #services: cognitive-services
 author: PatrickFarley
 manager: nitinme
 ms.author: pafarley
 ms.service: azure-ai-vision
 ms.topic: overview
-ms.date: 01/19/2024
+ms.date: 02/12/2024
+ms.custom: contperf-fy22q2, ignite-2022
 ---
 
-# What is Spatial Analysis?
+# What is Video Analysis?
 
-You can use Azure AI Vision Spatial Analysis to detect the presence and movements of people in video. Ingest video streams from cameras, extract insights, and generate events to be used by other systems. The service can do things like count the number of people entering a space or measure compliance with face mask and social distancing guidelines. By processing video streams from physical spaces, you're able to learn how people use them and maximize the space's value to your organization. 
+Video Analysis includes video-related features like Spatial Analysis and Video Retrieval.
+
+## Spatial Analysis
+
+You can use Azure AI Vision Spatial Analysis to detect the presence and movements of people in video. Ingest video streams from cameras, extract insights, and generate events to be used by other systems. The service can do things like count the number of people entering a space or measure compliance with face mask and social distancing guidelines. By processing video streams from physical spaces, you're able to learn how people use them and maximize the space's value to your organization.
 
 Try out the capabilities of Spatial Analysis quickly and easily in your browser using Vision Studio.
 
 > [!div class="nextstepaction"]
 > [Try Vision Studio](https://portal.vision.cognitive.azure.com/)
 
-<!--This documentation contains the following types of articles:
-* The [quickstarts](./quickstarts-sdk/analyze-image-client-library.md) are step-by-step instructions that let you make calls to the service and get results in a short period of time. 
-* The [how-to guides](./how-to/call-analyze-image.md) contain instructions for using the service in more specific or customized ways.
-* The [conceptual articles]() provide in-depth explanations of the service's functionality and features.
-* The [tutorials](./tutorials/storage-lab-tutorial.md) are longer guides that show you how to use this service as a component in broader business solutions.-->
-
-## What it does
-Spatial Analysis ingests video then detects people in the video. After people are detected, the system tracks the people as they move around over time then generates events as people interact with regions of interest. All operations give insights from a single camera's field of view. 
 
 ### People counting
 This operation counts the number of people in a specific zone over time using the PersonCount operation. It generates an independent count for each frame processed without attempting to track people across frames. This operation can be used to estimate the number of people in a space or generate an alert when a person appears.
@@ -50,23 +47,29 @@ Spatial Analysis can also be configured to detect if a person is wearing a prote
 
 ## Video Retrieval
 
-Spatial Analysis Video Retrieval is a service that lets you create a search index, add documents (videos and images) to it, and search with natural language. Developers can define metadata schemas for each index and ingest metadata to the service to help with retrieval. Developers can also specify what features to extract from the index (vision, speech) and filter their search based on features.
+Video Retrieval is a service that lets you create a search index, add documents (videos and images) to it, and search with natural language. Developers can define metadata schemas for each index and ingest metadata to the service to help with retrieval. Developers can also specify what features to extract from the index (vision, speech) and filter their search based on features.
 
-[Call the Video Retrieval APIs](./how-to/video-retrieval.md)
+> [!div class="nextstepaction"]
+> [Call the Video Retrieval APIs](./how-to/video-retrieval.md)
 
 ## Input requirements
 
+#### [Spatial Analysis](#tab/sa)
+
 Spatial Analysis works on videos that meet the following requirements:
 * The video must be in RTSP, rawvideo, MP4, FLV, or MKV format.
 * The video codec must be H.264, HEVC(H.265), rawvideo, VP9, or MPEG-4.
 
-## Get started
+#### [Video Retrieval](#tab/vr)
+
+[!INCLUDE [video-retrieval-input](./includes/video-retrieval-input.md)]
+
+---
 
-Follow the [quickstart](spatial-analysis-container.md) to set up the Spatial Analysis container and begin analyzing video.
 
 ## Responsible use of Spatial Analysis technology
 
-To learn how to use Spatial Analysis technology responsibly, see the [transparency note](/legal/cognitive-services/computer-vision/transparency-note-spatial-analysis?context=%2fazure%2fcognitive-services%2fComputer-vision%2fcontext%2fcontext). Microsoft's transparency notes help you understand how our AI technology works and the choices system owners can make that influence system performance and behavior. They focus on the importance of thinking about the whole system including the technology, people, and environment.
+To learn how to use Spatial Analysis technology responsibly, see the [Transparency note](/legal/cognitive-services/computer-vision/transparency-note-spatial-analysis?context=%2fazure%2fcognitive-services%2fComputer-vision%2fcontext%2fcontext). Microsoft's transparency notes help you understand how our AI technology works and the choices system owners can make that influence system performance and behavior. They focus on the importance of thinking about the whole system including the technology, people, and environment.
 
 ## Next steps
 
diff --git a/articles/ai-services/computer-vision/overview.md b/articles/ai-services/computer-vision/overview.md
@@ -27,7 +27,7 @@ Azure's Azure AI Vision service gives you access to advanced algorithms that pro
 | [Optical Character Recognition (OCR)](overview-ocr.md)|The Optical Character Recognition (OCR) service extracts text from images. You can use the new Read API to extract printed and handwritten text from photos and documents. It uses deep-learning-based models and works with text on various surfaces and backgrounds. These include business documents, invoices, receipts, posters, business cards, letters, and whiteboards. The OCR APIs support extracting printed text in [several languages](./language-support.md). Follow the [OCR quickstart](quickstarts-sdk/client-library.md) to get started.|
 |[Image Analysis](overview-image-analysis.md)| The Image Analysis service extracts many visual features from images, such as objects, faces, adult content, and auto-generated text descriptions. Follow the [Image Analysis quickstart](quickstarts-sdk/image-analysis-client-library-40.md) to get started.|
 | [Face](overview-identity.md) | The Face service provides AI algorithms that detect, recognize, and analyze human faces in images. Facial recognition software is important in many different scenarios, such as identification, touchless access control, and face blurring for privacy. Follow the [Face quickstart](quickstarts-sdk/identity-client-library.md) to get started. |
-| [Spatial Analysis](intro-to-spatial-analysis-public-preview.md)| The Spatial Analysis service analyzes the presence and movement of people on a video feed and produces events that other systems can respond to. Install the [Spatial Analysis container](spatial-analysis-container.md) to get started.|
+| [Video Analysis](intro-to-spatial-analysis-public-preview.md)| Video Analysis includes video-related features like Spatial Analysis and Video Retrieval. Spatial Analysis analyzes the presence and movement of people on a video feed and produces events that other systems can respond to. Install the [Spatial Analysis container](spatial-analysis-container.md) to get started. [Video Retrieval](/azure/ai-services/computer-vision/how-to/video-retrieval) lets you create an index of videos that you can search with natural language.|
 
 ## Azure AI Vision for digital asset management
 
diff --git a/articles/ai-services/computer-vision/reference-video-search.md b/articles/ai-services/computer-vision/reference-video-search.md
@@ -7,7 +7,7 @@ author: PatrickFarley
 manager: nitinme
 
 ms.service: azure-ai-vision
-ms.topic: how-to
+ms.topic: reference
 ms.date: 11/15/2023
 ms.author: pafarley
 ---
diff --git a/articles/ai-services/computer-vision/toc.yml b/articles/ai-services/computer-vision/toc.yml
@@ -378,9 +378,9 @@ items:
         href: https://aka.ms/azure-ai-vision-face-liveness-client-sdk-android-api-reference
       - name: Swift (iOS)
         href: https://aka.ms/azure-ai-vision-face-liveness-client-sdk-ios-api-reference
-- name: Spatial Analysis
+- name: Video Analysis
   items:
-  - name: Spatial Analysis overview
+  - name: Video Analysis overview
     href: intro-to-spatial-analysis-public-preview.md
   - name: Responsible use of AI
     items:
diff --git a/articles/ai-services/openai/how-to/gpt-with-vision.md b/articles/ai-services/openai/how-to/gpt-with-vision.md
