Merge pull request #211824 from Juliako/slate

started slate insights

Author: Maggiemouse1

articles/azure-video-indexer/clapperboard-metadata.md

@@ -0,0 +1,99 @@
+---
+title: Enable and view a clapperboard with extracted metadata
+description: Learn about how to enable and view a clapperboard with extracted metadata.
+author: Juliako
+manager: femila
+ms.topic: article
+ms.date: 09/20/2022
+ms.author: juliako
+---
+
+# Enable and view a clapperboard with extracted metadata (preview)
+
+The clapperboard insight is used to detect clapper board instances and information written on each. For example, *head* or *tail* (the board is upside-down), *production*, *roll*, *scene*, *take*, etc. A [clapperboard](https://en.wikipedia.org/wiki/Clapperboard)'s extracted metadata is most useful to customers involved in the movie post-production process. 
+
+When the movie is being edited, the slate is removed from the scene but a metadata with what's on the clapper board is important. Azure Video Indexer extracts the data from clapperboards, preserves and presents the metadata as described in this article.
+
+This insight is most useful to customers involved in the movie post-production process.
+
+## View the insight
+
+### View post-production insights
+
+In order to set the indexing process to include the slate metadata, select the **Video + audio indexing** -> **Advanced** presets.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/advanced-setting.png" alt-text="This image shows the advanced setting in order to view post-production clapperboards insights.":::
+
+After the file has been uploaded and indexed, if you want to view the timeline of the insight, select the **Post-production** checkmark from the list of insights.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/post-production-checkmark.png" alt-text="This image shows the post-production checkmark needed to view clapperboards.":::
+
+### Clapperboards
+
+Clapperboards contain titles, like: *production*, *roll*, *scene*, *take* and values associated with each title.
+
+The titles and their values' quality may not always be recognizable. For more information, see [limitations](#clapperboard-limitations).
+
+For example, take this clapperboard:
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/clapperboard.png" alt-text="This image shows a clapperboard.":::
+
+In the following example the board contains the following fields:
+
+|title|content|
+|---|---|
+|camera|COD|
+|date|FILTER (in this case the board contains no date)|
+|director|John|
+|production|Prod name|
+|scene|FPS|
+|take|99|
+
+#### View the insight
+
+To see the instances on the website, select **Insights** and scroll to **Clapperboards**. You can hover over each clapperboard, or unfold **Show/Hide clapperboard info** and see the metadata:
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/clapperboard-metadata.png" alt-text="This image shows the clapperboard metadata.":::
+
+#### View the timeline
+
+If you checked the **Post-production** insight, You can also find the clapperboard instance and its timeline (includes time, fields' values) on the **Timeline** tab.
+
+#### Vew JSON
+
+To display the JSON file: 
+
+1. Select Download and then Insights (JSON).  
+1. Copy the `clapperboard` element, under `insights`, and paste it into your Online JSON Viewer. 
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/clapperboard-json.png" alt-text="This image shows the clapperboard metadata in json.":::
+
+The following table describes fields found in json:
+
+|Name|Description|
+|---|---|
+|`id`|The clapperboard ID.|
+|`thumbnailId`|The ID of the thumbnail.|
+|`isHeadSlate`|The value stands for head or tail (the board is upside-down) of the clapper board: `true` or `false`.|
+|`fields`|The fields found in the clapper board; also each field's name and value.|
+|`instances`|A list of time ranges where this element appeared.|
+
+## Clapperboard limitations
+
+- The titles of the fields appearing on the clapper board are optimized to identify the most popular fields appearing on top of clapper boards.  
+- Handwritten text or digital digits may not be correctly identified by the fields detection algorithm.
+- The algorithm is optimized to identify fields categories that appear horizontally.  
+- The clapper board may not be detected if the frame is blurred or that the text written on it can't be identified by the human eye.  
+- Empty fields’ values may lead to to wrong fields categories.  
+<!-- If a part of a clapper board is hidden a value with the highest confidence is shown.  -->
+
+## Next steps
+
+* [Slate detection overview](slate-detection-insight.md)
+* [How to enable and view digital patterns with color bars](digital-patterns-color-bars.md).
+* [How to enable and view textless slate with matched scene](textless-slate-scene-matching.md).

articles/azure-video-indexer/digital-patterns-color-bars.md

@@ -0,0 +1,83 @@
+---
+title: Enable and view digital patterns with color bars
+description: Learn about how to enable and view digital patterns with color bars.
+author: Juliako
+manager: femila
+ms.topic: article
+ms.date: 09/20/2022
+ms.author: juliako
+---
+
+# Enable and view digital patterns with color bars (preview)
+
+This article shows how to enable and view digital patterns with color bars (preview). 
+
+You can view the names of the specific digital patterns. <!-- They are searchable by the color bar type (Color Bar/Test card) in the insights. -->The timeline includes the following types: 
+
+- Color bars
+- Test cards
+
+This insight is most useful to customers involved in the movie post-production process.
+
+## View post-production insights
+
+In order to set the indexing process to include the slate metadata, select the **Video + audio indexing** -> **Advanced** presets.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/advanced-setting.png" alt-text="This image shows the advanced setting in order to view post-production clapperboards insights.":::
+
+After the file has been uploaded and indexed, if you want to view the timeline of the insight, select the **Post-production** checkmark from the list of insights.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/post-production-checkmark.png" alt-text="This image shows the post-production checkmark needed to view clapperboards.":::
+
+### View digital patterns insights
+
+#### View the insight
+
+To see the instances on the website, select **Insights** and scroll to **Labels**.
+The insight shows under **Labels** in the **Insight** tab.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/insights-color-bars.png" alt-text="This image shows the color bars under labels.":::
+
+#### View the timeline
+
+If you checked the **Post-production** insight, you can find the color bars instance and timeline under the **Timeline** tab.
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/timeline-color-bars.png" alt-text="This image shows the color bars under timeline.":::
+
+#### View JSON
+
+To display the JSON file: 
+
+1. Select Download and then Insights (JSON).  
+1. Copy the `framePatterns` element, under `insights`, and paste it into your Online JSON Viewer. 
+
+> [!div class="mx-imgBorder"]
+> :::image type="content" source="./media/slate-detection-process/color-bar-json.png" alt-text="This image shows the color bars json.":::
+
+The following table describes fields found in json:
+
+|Name|Description|
+|---|---|
+|`id`|The digital pattern ID.|
+|`patternType`|The following types are supported: ColorBars, TestCards.|
+|`confidence`|The confidence level for color bar accuracy.|
+|`name`|The name of the element. For example, "SMPTE color bars".|
+|`displayName`| The friendly/display name.
+|`thumbnailId`|The ID of the thumbnail.|
+|`instances`|A list of time ranges where this element appeared.|
+
+## Limitations
+
+- There can be a mismatch if the input video is of low quality (for example – old Analog recordings). 
+- The digital patterns will be identified over the 10 min of the beginning and 10 min of the ending part of the video.  
+<!-- -  What about the limited set of digital patterns that we compare to? It's not any digital pattern -->
+
+## Next steps
+
+* [Slate detection overview](slate-detection-insight.md)
+* [How to enable and view clapper board with extracted metadata](clapperboard-metadata.md)
+* [How to enable and view textless slate with matched scene](textless-slate-scene-matching.md)