You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Azure Communication Services Voice and Video Insights
3
3
titleSuffix: An Azure Communication Services concept document
4
4
description: Descriptions of data visualizations available for Voice and Video Communications Services via Workbooks
5
-
author: mkhribech
5
+
author: amagginetti
6
6
services: azure-communication-services
7
7
8
-
ms.author: mkhribech
8
+
ms.author: amagginetti
9
9
ms.date: 03/08/2021
10
10
ms.topic: conceptual
11
11
ms.service: azure-communication-services
@@ -14,51 +14,100 @@ ms.subservice: data
14
14
15
15
# Voice and video Insights
16
16
17
-
In this document, we outline the available insights dashboard to monitor Voice and Video logs and metrics.
17
+
This document introduces the Voice and Video section of your Insights dashboard.
18
+
19
+
<!-- and how to use Copilot in Azure to monitor and improve your call quality. -->
18
20
19
21
## Overview
20
-
Within your Communications Resource, we've provided an **Insights** feature that displays many data visualizations conveying insights from the Azure Monitor logs and metrics monitored for your Communications Services. The visualizations within Insights are made possible via [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview). In order to take advantage of Workbooks, follow the instructions outlined in [Enable Azure Monitor in Diagnostic Settings](../enable-logging.md). To enable Workbooks, you need to send your logs to a [Log Analytics workspace](/azure/azure-monitor/logs/log-analytics-overview) destination.
22
+
In each Communications Resource, we provide an Insights feature that
23
+
acts as a dashboard for all your calls in that resource. The Voice and Video
24
+
section of the dashboard gives high level summaries of your call usage,
25
+
reliability, and quality for that calling resource.
26
+
27
+
<!-- This dashboard
28
+
is integrated with [Copilot in Azure](/azure/copilot/overview), allowing you to chat with Copilot to quickly understand the data you’re looking at and learn actions to improve your users' calling experiences. -->
29
+
30
+
<!-- Insert example prompts and images:
31
+
1
32
+
2
33
+
3 -->
34
+
35
+
There are two main tools you can use to monitor your calls and improve call quality.
We recommend using the **Voice and Video Insights** dashboards to start
40
+
any quality investigations, and using [Call Diagnostics](../../voice-video-calling/call-diagnostics.md) as needed to explore individual calls when you need granular detail.
41
+
42
+
<!-- We recommend using Copilot in the **Voice and Video Insights** dashboards to start
43
+
any quality investigations, and using Copilot in [Call Diagnostics](../../voice-video-calling/call-diagnostics.md) as needed to explore individual calls when you need granular detail.
44
+
45
+
**Voice and Video Insights** consists of four main sections.
46
+
- **[Volume](#volume):** Provides general usage numbers.
47
+
- **[Reliability](#reliability):** Aggregates key calling API scenarios and error codes.
48
+
- **[User Facing Diagnostics (UFD)](#user-facing-diagnostics-ufd):** Summarizes events that can affect user call experiences.
49
+
- **[Quality](#quality):** Provides key media stream measurements. -->
50
+
51
+
52
+
## Enable Voice and Video Insights
53
+
54
+
You need to start storing call logs to start using the Voice and Video Insights dashboards.
21
55
22
-
:::image type="content" source="..\media\workbooks\insights-overview-2.png" alt-text="Screenshot of Communication Services Insights dashboard.":::
56
+
<!-- You need to start storing call logs and enable [Copilot in Azure](/azure/copilot/overview) to start using the Voice and Video Insights dashboards. -->
23
57
24
-
## Prerequisites
25
58
26
-
- In order to take advantage of Workbooks, follow the instructions outlined in [Enable Logging with Azure Monitor](../enable-logging.md). You need to enable `Operational Authentication Logs`, `Call Summary Logs`, `Call Diagnostic Logs`.
27
-
- To use Workbooks, you need to send your logs to a [Log Analytics workspace](/azure/azure-monitor/logs/log-analytics-overview) destination.
59
+
> [!IMPORTANT]
60
+
>You must collect logs to use the dashboard. To enable Voice and Video Insights see: **[How do I set up Voice and Video Insights?](#how-do-i-set-up-voice-and-video-insights)**
61
+
>
62
+
>Azure doesn't store your call log data unless you enable these specific Diagnostic Settings. Your call data is not retroactively available. You accumulate data once you set up the Diagnostic Settings.
28
63
29
-
## Accessing Azure Insights for Communication Services
64
+
## Accessing Voice and Video Insights
30
65
31
-
Inside your Azure Communication Services resource, scroll down on the left nav bar to the **Monitor** category and click on the **Insights** tab:
66
+
Inside your Azure Communication Services resource, scroll down on the left navigation bar to the **Monitor** category and select the **Insights** tab:
32
67
33
-
:::image type="content" source="..\media\workbooks\acs-insights-nav.png" alt-text="Screenshot of the Insights navigation blade.":::
68
+
:::image type="content" source="..\media\workbooks\acs-insights-nav.png" alt-text="Screenshot of the Insights navigation icon.":::
34
69
35
-
## Authentication insights
36
70
37
-
The **Authentication** tab shows authentication logs, which are created through operations such as issuing an access token or creating an identity. The data displayed includes the types of operations performed and the results of those operations:
71
+
## Volume
38
72
39
-
:::image type="content" source="..\media\workbooks\auth.png" alt-text="Screenshot of the authentication overview.":::
73
+
<!--:::image type="content" source="..\media\workbooks\voice-and-video-nav.png" alt-text="Screenshot of voice and video navigation.":::-->
40
74
41
-
## Voice and Video Insights
75
+
The **Volume** tab plots key usage metrics, such as call and participant volume, you can use the filters to focus your reviews and time frames.
42
76
43
-
Since **Voice and video** logs are the most complex in nature, this modality is broken down into four subsections:
77
+
<!-- You can use Copilot to get detailed explanations of key concepts at the bottom of this section. -->
44
78
45
-
:::image type="content" source="..\media\workbooks\voice-and-video-nav.png" alt-text="Screenshot of voice and video navigation.":::
79
+
This tab focuses on the composition and volume of your calls over time. You can see average call duration in a period or focus on top users by average call duration. We provide more information with breakdowns by SDK version, Teams interoperability, participant types, call type, endpoint type, and OS version.
46
80
47
-
The **Summary** tab contains general information about Voice and video usage, including the types of media streams shared, the types of endpoints participating in a call (e.g. VoIP, Bot, Application, PSTN, or Server), the OS usage, and participant end reasons:
48
81
49
-
:::image type="content" source="..\media\workbooks\voice-and-video-summary.png" alt-text="Screenshot of voice and video summary.":::
82
+
<!--:::image type="content" source="..\media\workbooks\voice-and-video-summary.png" alt-text="Screenshot of voice and video summary.":::-->
50
83
51
-
The **Volume** tab under the **Voice and video** modality displays the number of calls and the number of participants in a specific period of time (**Time range** parameter), subdivided into time bins (**Time granularity** parameter):
84
+
<!--The **Volume** tab under the **Voice and video** modality displays the number of calls and the number of participants in a specific period of time (**Time range** parameter), subdivided into time bins (**Time granularity** parameter):
52
85
53
86
:::image type="content" source="..\media\workbooks\voice-and-video-volume.png" alt-text="Screenshot of voice and video volume.":::
54
87
55
88
The **Volume** tab contains a **Grouping** parameter, which helps visualize the number of calls and participants segmented by either Call type (P2P vs. Group calls) and Interop Calls (pure Azure Communication Services vs. Teams Interop):
56
89
57
-
:::image type="content" source="..\media\workbooks\voice-and-video-volume-grouping.png" alt-text="Screenshot of voice and video volume grouping.":::
90
+
:::image type="content" source="..\media\workbooks\voice-and-video-volume-grouping.png" alt-text="Screenshot of voice and video volume grouping."::: -->
91
+
92
+
<!-- ## Reliability
93
+
The **Reliability** tab summarizes the performance of key calling SDK APIs to help you focus on the lowest performing areas. The default view shows a trend of all the APIs to give you an overview of your reliability. You can get more details by selecting a single API scenario to focus on. When you choose a single API scenario the dashboard visuals update to show a detailed breakdown of that API and highlight where you can chat with Copilot to learn about individual error codes and possible solutions to improve performance.
94
+
95
+
## User Facing Diagnostics (UFD)
96
+
97
+
The User Facing Diagnostic (UFD) tab opens with a summary of the top UFD events and highlights the recovery rate of each UFD for you to focus on. Like the Reliability tab, you see an overview of all the UFDs first. Then you can interact with Copilot and select an individual UFD for further drill-down insights.
98
+
99
+
We recommend prioritizing improvements on a UFD that has a low recovery rate and a high volume, which can indicate the best opportunity to improve your user's call experiences. For example, the calling SDK might recover from some in call events and the user might not perceive an issue. By focusing on the poorest performing areas you can help identify root causes.
100
+
101
+
### How do you interpret UFDs?
102
+
103
+
During calls, the calling SDK might trigger events called User Facing Diagnostics (UFDs), these UFD events indicate a user may have perceived a poor call experience for various reasons. For example, their video freezes and their network quality drops in the middle of a call. Since UFDs are symptomatic by nature and are triggered based on broad quantitative criteria, there can be various root causes that trigger a UFD event. Additionally, a UFD can be triggered but the user might not perceive an issue during a call because the calling SDK was able to mitigate any potential issue. In contrast, the reliability tab attempts to provide more concrete error code and subcode information for your analysis.
104
+
-->
105
+
106
+
## Quality
58
107
59
108
The **Quality** tab under **Voice and video** allows users to inspect the quality distribution of calls, where quality is defined at three levels for this dashboard:
60
109
61
-
- The proportion of poor-quality media streams (**Stream quality** plot), where a stream’s quality is classified as Poor when it has at least one unhealthy telemetry value, where unhealthy ranges are defined as:
110
+
- The proportion of poor-quality media streams (**Stream quality** plot), where a stream’s quality is classified as Poor when it has at least one unhealthy value, unhealthy ranges are defined as:
62
111
- Jitter > 30 milliseconds
63
112
- Packet loss rate > 10%
64
113
- Round trip time > 500 milliseconds
@@ -67,40 +116,69 @@ The **Quality** tab under **Voice and video** allows users to inspect the qualit
67
116
68
117
-**Participant end reasons**, which keep track of the reason why a participant left a call. End reasons are [SIP codes](https://en.wikipedia.org/wiki/List_of_SIP_response_codes), which are numeric codes that describe the specific status of a signaling request. SIP codes can be grouped into six categories: *Success*, *Client Failure*, *Server Failure*, *Global Failure*, *Redirection*, and *Provisional*. The distribution of SIP code categories is shown in the pie chart on the left hand side, while a list of the specific SIP codes for participant end reasons is provided on the right hand side
69
118
70
-
:::image type="content" source="..\media\workbooks\voice-and-video-quality.png" alt-text="Screenshot of voice and video quality.":::
119
+
<!--:::image type="content" source="..\media\workbooks\voice-and-video-quality.png" alt-text="Screenshot of voice and video quality.":::-->
71
120
72
-
Quality can also be filtered by the types of media streams (**Media Type** parameter) used in the call, e.g. to only get the impacted calls in terms of video stream quality:
121
+
Quality can also be filtered by the types of media streams (**Media Type** parameter) used in the call, for example, to only get the impacted calls in terms of video stream quality:
73
122
74
-
:::image type="content" source="..\media\workbooks\voice-and-video-quality-params.png" alt-text="Screenshot voice and video quality media type parameter.":::
123
+
<!--:::image type="content" source="..\media\workbooks\voice-and-video-quality-params.png" alt-text="Screenshot voice and video quality media type parameter.":::-->
75
124
76
-
And can also be filtered by endpoint types (**Endpoint Type** parameter), e.g. getting the participant end reasons for PSTN participants. These filters allow for multiple selections:
125
+
And can also be filtered by endpoint types (**Endpoint Type** parameter), for example, getting the participant end reasons for PSTN participants. These filters allow for multiple selections:
77
126
78
-
:::image type="content" source="..\media\workbooks\voice-and-video-params-2.png" alt-text="Screenshot voice and video quality endpoint type parameter.":::
127
+
<!--:::image type="content" source="..\media\workbooks\voice-and-video-params-2.png" alt-text="Screenshot voice and video quality endpoint type parameter.":::-->
79
128
80
-
The **Details** tab offers a quick way to navigate through the **Voice and video** calls made in a time range by grouping calls by dates, and showing the details of every call made in terms of the participants in that call and the outgoing streams per participant, together with duration and telemetry values for these:
129
+
## More information about workbooks
81
130
82
-
:::image type="content" source="..\media\workbooks\voice-and-video-details.png" alt-text="Screenshot of voice and video details.":::
131
+
For an in-depth description of workbooks, refer to the [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview) documentation.
83
132
84
-
The details of a call are initially hidden. A list of the participants is displayed after clicking on a call:
133
+
## Editing dashboards
85
134
86
-
:::image type="content" source="..\media\workbooks\voice-and-video-details-participants.png" alt-text="Screenshot of voice and video participant details.":::
135
+
The **Insights** dashboards we provide can be customized to better suit your needs by clicking on the **Edit** button on the top navigation bar:
87
136
88
-
And clicking on a participant displays a list of the outgoing streams for that participant, together with their duration (proportional to the full call duration) and telemetry values, where unhealthy values are displayed in red:
137
+
:::image type="content" source="..\media\workbooks\dashboard-editing.png" alt-text="Screenshot of dashboard editing process.":::
89
138
90
-
:::image type="content" source="..\media\workbooks\voice-and-video-details-streams.png" alt-text="Screenshot of voice and video stream details.":::
139
+
Editing these dashboards creates a separate workbook that can be accessed from your resource’s Workbooks tab:
91
140
92
-
## More information about workbooks
141
+
:::image type="content" source="..\media\workbooks\workbooks-tab.png" alt-text="Screenshot of the workbooks tab.":::
93
142
94
143
For an in-depth description of workbooks, refer to the [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview) documentation.
95
144
96
-
## Editing dashboards
97
145
98
-
The **Insights** dashboards provided with your **Communication Service** resource can be customized by clicking on the **Edit** button on the top navigation bar:
146
+
## Frequently asked questions
99
147
100
-
:::image type="content" source="..\media\workbooks\dashboard-editing.png" alt-text="Screenshot of dashboard editing process.":::
148
+
### How do I set up Voice and Video Insights?
149
+
Since the Voice and Video insights dashboard is powered by [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview), you need to store call logs for it to visualize anything. The following section explains this requirement.
101
150
102
-
Editing these dashboards doesn't modify the **Insights** tab, but rather creates a separate workbook that can be accessed on your resource’s Workbooks tab:
151
+
<!-- Since the Voice and Video insights dashboard is integrated with [Copilot in Azure](/azure/copilot/overview) and powered by [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview), you need to store call logs for it to visualize anything. Also you must enable [Copilot in Azure](/azure/copilot/overview). The following sections explain these two requirements. -->
103
152
104
-
:::image type="content" source="..\media\workbooks\workbooks-tab.png" alt-text="Screenshot of the workbooks tab.":::
153
+
#### Collect Call Logs
105
154
106
-
For an in-depth description of workbooks, refer to the [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview) documentation.
155
+
The Insights Dashboards uses [Azure Monitor Workbooks](/azure/azure-monitor/visualize/workbooks-overview) which displays call log data from Azure Communication Services. These call logs aren't stored in your Azure account by default so you need to begin storing them for the dashboard to work. To collect these call logs, you need to enable a diagnostic setting that sends call data to a Log Analytics workspace in the same resource group as your calling resource.
156
+
157
+
**Data isn’t stored retroactively, so you begin capturing call logs only after configuring the diagnostic setting.**
158
+
159
+
Follow instructions to add diagnostic settings for your resource in [Enable logs via Diagnostic Settings in Azure Monitor](../enable-logging.md). We recommend that you initially collect all logs. After you understand the capabilities in Azure Monitor, determine which logs you want to retain and for how long. When you add your diagnostic setting, you're prompted to [select logs](../enable-logging.md#adding-a-diagnostic-setting). To collect **all logs**, select **allLogs**.
160
+
161
+
Your data volume, retention, and usage in Log Analytics within Azure Monitor is billed through existing Azure data meters. We recommend that you monitor your data usage and retention policies for cost considerations as needed. For more information, see [Controlling costs](/azure/azure-monitor/essentials/diagnostic-settings#controlling-costs).
162
+
163
+
If you have multiple Azure Communications Services resource IDs, you must enable these settings for each resource ID. When you view Voice and Video Insights, it shows you details for the resourceID you're viewing.
164
+
165
+
<!-- #### Enable Copilot in Azure
166
+
Your organization manages access to [Copilot in Azure](/azure/copilot/overview). After your organization has access to Copilot in Azure, the Voice and Video Insights sections will display multiple Copilot icons you can interact with.
167
+
168
+
Interact with Copilot in Azure for quality improvement guidance and explanations of common terms. Giving Copilot in Azure detailed information helps it identify fixes. If you want, you can use the visuals without Copilot in a limited capacity. -->
169
+
170
+
## Next steps
171
+
172
+
- Learn about Call Diagnostics: [Call Diagnostics](../../voice-video-calling/call-diagnostics.md)
173
+
- Learn how to manage call quality: [Improve and manage call quality](../../voice-video-calling/manage-call-quality.md).
174
+
- Explore troubleshooting guidance: [Overview of audio issues](../../../resources/troubleshooting/voice-video-calling/audio-issues/overview.md).
175
+
- Learn about other quality best practices: [Best practices: Azure Communication Services calling SDKs](../../best-practices.md).
176
+
- Learn how to use the Log Analytics workspace: [Log Analytics tutorial](/azure/azure-monitor/logs/log-analytics-tutorial).
177
+
- Create your own queries in Log Analytics: [Get started with log queries in Azure Monitor](/azure/azure-monitor/logs/get-started-queries).
178
+
- Explore known call issues: [Known issues in the SDKs and APIs](../../known-issues.md).
179
+
180
+
181
+
182
+
<!-- - NOTES
183
+
184
+
:::image type="content" source="..\media\workbooks\insights-overview-2.png" alt-text="Screenshot of Communication Services Insights dashboard."::: -->
0 commit comments