You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/applied-ai-services/metrics-advisor/how-tos/configure-metrics.md
+50-52Lines changed: 50 additions & 52 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,93 +8,94 @@ manager: nitinme
8
8
ms.service: applied-ai-services
9
9
ms.subservice: metrics-advisor
10
10
ms.topic: how-to
11
-
ms.date: 09/10/2020
11
+
ms.date: 05/12/2022
12
12
ms.author: mbullwin
13
13
---
14
14
15
-
# How to: Configure metrics and fine tune detection configuration
15
+
# Configure metrics and fine tune detection configuration
16
16
17
-
Use this article to start configuring your Metrics Advisor instance using the web portal. To browse the metrics for a specific data feed, go to the **Data feeds** page and select one of the feeds. This will display a list of metrics associated with it.
17
+
Use this article to start configuring your Metrics Advisor instance using the web portal and fine-tune the anomaly detection results.
18
+
19
+
## Metrics
20
+
21
+
To browse the metrics for a specific data feed, go to the **Data feeds** page and select one of the feeds. This will display a list of metrics associated with it.
18
22
19
23
:::image type="content" source="../media/metrics/select-metric.png" alt-text="Select a metric" lightbox="../media/metrics/select-metric.png":::
20
24
21
-
Select one of the metric names to see its details. In this detailed view, you can switch to another metric in the same data feed using the dropdown list in the top right corner of the screen.
25
+
Select one of the metric names to see its details. In this view, you can switch to another metric in the same data feed using the drop-down list in the top right corner of the screen.
22
26
23
-
When you first view a metric's details, you can load a time series by letting Metrics Advisor choose one for you, or by specifying values to be included for each dimension.
27
+
When you first view a metric's details, you can load a time series by letting Metrics Advisor choose one for you, or by specifying values to be included for each dimension.
24
28
25
29
You can also select time ranges, and change the layout of the page.
26
30
27
31
> [!NOTE]
28
32
> - The start time is inclusive.
29
-
> - The end time is exclusive.
33
+
> - The end time is exclusive.
30
34
31
-
You can click the **Incidents** tab to view anomalies, and find a link to the [Incident hub](diagnose-an-incident.md).
35
+
You can select the **Incidents** tab to view anomalies, and find a link to the [Incident hub](diagnose-an-incident.md).
32
36
33
37
## Tune the detection configuration
34
38
35
-
A metric can apply one or more detection configurations. There is a default configuration for each metric, which you can edit or add to, according to your monitoring needs.
39
+
A metric can apply one or more detection configurations. There's a default configuration for each metric, which you can edit or add to, according to your monitoring needs.
36
40
37
-
### (NEW) Detection configuration auto-tuning based on anomaly preference
41
+
### Detection configuration auto-tuning based on anomaly preference
38
42
39
-
Detection configuration auto-tuning is a new feature released in Metrics Advisor, mainly to address the painpoints of following:
43
+
Detection configuration auto-tuning is a new feature released in Metrics Advisor, to help address the following scenarios:
40
44
41
-
- In different use cases, the interest on types of anomaly is different. Some may be interested in sudden spikes or dips, but in some other cases, spikes/dips or transient anomalies are not critical. Previously it's hard to distinguish the configuration for different anomaly types, the new auto-tuning feature has made this possible. As of now, there're 5 anomaly patterns supported:
42
-
43
-
1. Spike
44
-
2. Dip
45
-
3. Increase
46
-
4. Decrease
47
-
5. Steady
45
+
- Depending on the use case, certain types of anomalies may be of more significant interest. Sometimes you may be interested in sudden spikes or dips, but other cases, spikes/dips or transient anomalies aren't critical. Previously it was hard to distinguish the configuration for different anomaly types. The new auto-tuning feature makes this distinction between anomaly types possible. As of now, there are five supported anomaly patterns:
46
+
* Spike
47
+
* Dip
48
+
* Increase
49
+
* Decrease
50
+
* Steady
48
51
49
-
- Sometimes, there might be many dimensions within one metric, which would split the metric into hundreds, thousands or even more time series to be monitored. However, they are not equally important. Take revenue as an example, the number on small regions or niche product category would be quite tiny and also not that stable. The new auto-tuning feature has made it possible to fine tune configuration based on series value range.
52
+
- Sometimes, there may be many dimensions within one metric, which will split the metric into hundreds, thousands, or even more time series to be monitored. However, often some of these dimensions aren't equally important. Take revenue as an example, the number for small regions or a niche product category might be quite small and therefore also not that stable. But at the same time not necessarily critical. The new auto-tuning feature has made it possible to fine tune configuration based on series value range.
50
53
51
-
Eventually, users don't need to spend long time to fine tune the configuration again and again, and also alert noise will be reduced by applying the 'customized' configuration.
54
+
This allows you to not have to spend as much effort fine tuning your configuration again and again, and also reduces alert noise.
52
55
53
56
> [!NOTE]
54
-
> The auto-tuning feature is only applied on 'Smart detection' method.
57
+
> The auto-tuning feature is only applied on the 'Smart detection' method.
55
58
56
-
**Prerequisite on triggering auto-tuning**
59
+
### Prerequisite for triggering auto-tuning
57
60
58
-
After the metrics are onboarded to Metrics Advisor, the system will try to perform statistics on the metrics to categorize 'anomaly pattern' types and 'series value' distribution. By providing those to the users, users can further fine tune the configuration based on their specific preference. At the beginning, it will show a status of 'Initializing'.
61
+
After the metrics are onboarded to Metrics Advisor, the system will try to perform statistics on the metrics to categorize **anomaly pattern** types and **series value** distribution. By providing this functionality, you can further fine tune the configuration based on their specific preferences. At the beginning, it will show a status of 'Initializing'.
**Choose to enable auto-tuning on 'anomaly pattern' and 'series value'**
65
+
### Choose to enable auto-tuning on anomaly pattern and series value
63
66
64
-
As the pain-points shared before, the feature enables users to tuning detection configuration from two perspective 'anomaly pattern' and 'series value'. Based on specific use case, users can choose which one to be enabled or both.
67
+
The feature enables you to tune detection configuration from two perspectives **anomaly pattern** and **series value**. Based on your specific use case, you can choose which one to enabled or enable both.
65
68
66
-
- For 'anomaly pattern' preference, the system will list out different anomaly patterns that observed in the metric. Users can choose which ones they're interested in and select them, the unselected ones their sensitivity will be **reduced** by default.
69
+
- For the **anomaly pattern** option, the system will list out different anomaly patterns that were observed with the metric. You can choose which ones you're interested in and select them, the unselected patterns will have their sensitivity **reduced** by default.
67
70
68
-
- For 'series value' preference, it really depends on specific use case. If users would like to use a higher sensitivity for series with higher values, and decrease sensitivity on low value ones, or vice versa. Then please check the checkbox.
71
+
- For the **series value** option, your selection will depend on your specific use case. You'll have to decide if you want to use a higher sensitivity for series with higher values, and decrease sensitivity on low value ones, or vice versa. Then check the checkbox.
**Tune the configuration for selected anomaly patterns**
75
+
### Tune the configuration for selected anomaly patterns
73
76
74
-
If interested anomaly patterns have been chosen, the next step is to fine tune the configuration for each. There's a global 'sensitivity' that applied for all series. For each anomaly pattern, users can tune the 'adjustment', which is based on the global 'sensitivity'.
77
+
If specific anomaly patterns are chosen, the next step is to fine tune the configuration for each. There's a global **sensitivity** that is applied for all series. For each anomaly pattern, you can tune the **adjustment**, which is based on the global **sensitivity**.
75
78
76
-
Please remember to tune on each anomaly pattern that been chosen respectively.
79
+
You must tune each anomaly pattern that has been chosen individually.
**Tune the configuration for each series value group**
83
+
### Tune the configuration for each series value group
81
84
82
-
After the system performs statistics on all time series within the metric, several series value groups are generated automatically. Same as above, users can fine tune the 'adjustment' for each series value group according to specific business needs.
85
+
After the system generates statistics on all time series within the metric, several series value groups are created automatically. As described above, you can fine tune the **adjustment** for each series value group according to your specific business needs.
83
86
84
-
There will be a default adjustment been configured to get the best detection results, but it can be further tuned.
87
+
There will be a default adjustment configured to get the best detection results, but it can be further tuned.
Even the detection configuration on capturing valid anomalies is tuned, it's still important to input 'alert
91
-
rules' to make sure the final alert rules can meet eventual business needs. There're a bunch of rules can be set, like 'filter rules' or 'snooze continuous alert rules'...
93
+
Even once the detection configuration on capturing valid anomalies is tuned, it's still important to input **alert
94
+
rules** to make sure the final alert rules can meet eventual business needs. There are a number of rules that can be set, like **filter rules** or **snooze continuous alert rules**.
After configuring all above settings, the system will orchestrate them together and automatically detect anomalies based on inputted preference. The goal to get the best configuration that works for each metric can be achieved much easier by the new 'auto-tuning' feature!
97
-
98
+
After configuring all the settings described in the section above, the system will orchestrate them together and automatically detect anomalies based on your inputted preferences. The goal is to get the best configuration that works for each metric, which can be achieved much easier through use of the new **auto-tuning** capability.
98
99
99
100
### Tune the configuration for all series in current metric
100
101
@@ -106,7 +107,7 @@ There are additional parameters like **Direction**, and **Valid anomaly** that c
106
107
107
108
### Tune the configuration for a specific series or group
108
109
109
-
Click**Advanced configuration** below the metric level configuration options to see the group level configuration.You can add a configuration for an individual series, or group of series by clicking the **+** icon in this window. The parameters are similar to the metric-level configuration parameters, but you may need to specify at least one dimension value for a group-level configuration to identify a group of series. And specify all dimension values for series-level configuration to identify a specific series.
110
+
Select**Advanced configuration** below the metric level configuration options to see the group level configuration.You can add a configuration for an individual series, or group of series by clicking the **+** icon in this window. The parameters are similar to the metric-level configuration parameters, but you may need to specify at least one dimension value for a group-level configuration to identify a group of series. And specify all dimension values for series-level configuration to identify a specific series.
110
111
111
112
This configuration will be applied to the group of series or specific series instead of the metric level configuration. After setting the conditions for this group, save it.
112
113
@@ -140,7 +141,7 @@ When the sensitivity is turned down, the expected value range will be wider, and
140
141
Change threshold is normally used when metric data generally stays around a certain range. The threshold is set according to **Change percentage**. The **Change threshold** mode is able to detect anomalies in the scenarios:
141
142
142
143
* Your data is normally stable and smooth. You want to be notified when there are fluctuations.
143
-
* Your data is normally quite unstable and fluctuates a lot. You want to be notified when it becomes too stable or flat.
144
+
* Your data is normally unstable and fluctuates a lot. You want to be notified when it becomes too stable or flat.
144
145
145
146
Use the following steps to use this mode:
146
147
@@ -173,8 +174,8 @@ Sometimes, expected events and occurrences (such as holidays) can generate anoma
173
174
> [!Note]
174
175
> Preset event configuration will take holidays into consideration during anomaly detection, and may change your results. It will be applied to the data points ingested after you save the configuration.
175
176
176
-
Click the **Configure Preset Event** button next to the metrics drop-down list on each metric details page.
177
-
177
+
Select the **Configure Preset Event** button next to the metrics drop-down list on each metric details page.
In the window that appears, configure the options according to your usage. Make sure **Enable holiday event** is selected to use the configuration.
@@ -188,17 +189,16 @@ There are several other values you can configure:
188
189
189
190
|Option |Description |
190
191
|---------|---------|
191
-
|**Choose one dimension as country**| Choose a dimension that contains country information. For example a country code. |
192
+
|**Choose one dimension as country**| Choose a dimension that contains country information. For example, a country code. |
192
193
|**Country code mapping**| The mapping between a standard [country code](https://wikipedia.org/wiki/ISO_3166-1_alpha-2), and chosen dimension's country data. |
193
194
|**Holiday options**| Whether to take into account all holidays, only PTO (Paid Time Off) holidays, or only Non-PTO holidays. |
194
195
|**Days to expand**| The impacted days before and after a holiday. |
195
196
197
+
The **Cycle event** section can be used in some scenarios to help reduce unnecessary alerts by using cyclic patterns in the data. For example:
196
198
197
-
The **Cycle event** section can be used in some scenarios to help reduce unnecessary alerts by using cyclic patterns in the data. For example:
199
+
- Metrics that have multiple patterns or cycles, such as both a weekly and monthly pattern.
200
+
- Metrics that don't have a clear pattern, but the data is comparable Year over Year (YoY), Month over Month (MoM), Week Over Week (WoW), or Day Over Day (DoD).
198
201
199
-
- Metrics that have multiple patterns or cycles, such as both a weekly and monthly pattern.
200
-
- Metrics that do not have a clear pattern, but the data is comparable Year over Year (YoY), Month over Month (MoM), Week Over Week (WoW), or Day Over Day (DoD).
201
-
202
202
Not all options are selectable for every granularity. The available options per granularity are below (✔ for available, X for unavailable):
203
203
204
204
| Granularity | YoY | MoM | WoW | DoD |
@@ -212,7 +212,6 @@ Not all options are selectable for every granularity. The available options per
212
212
| Secondly | X | X | X | X |
213
213
| Custom*| ✔ | ✔ | ✔ | ✔ |
214
214
215
-
216
215
When using a custom granularity in seconds, only available if the metric is longer than one hour and less than one day.
217
216
218
217
Cycle event is used to reduce anomalies if they follow a cyclic pattern, but it will report an anomaly if multiple data points don't follow the pattern. **Strict mode** is used to enable anomaly reporting if even one data point doesn't follow the pattern.
@@ -221,14 +220,13 @@ Cycle event is used to reduce anomalies if they follow a cyclic pattern, but it
221
220
222
221
## View recent incidents
223
222
224
-
Metrics Advisor detects anomalies on all your time series data as they're ingested. However, not all anomalies need to be escalated, because they might not have a big impact. Aggregation will be performed on anomalies to group related ones into incidents. You can view these incidents from the **Incident** tab in metrics details page.
223
+
Metrics Advisor detects anomalies on all your time series data as they're ingested. However, not all anomalies need to be escalated, because they might not have a significant impact. Aggregation will be performed on anomalies to group related ones into incidents. You can view these incidents from the **Incident** tab in metrics details page.
225
224
226
-
Click on an incident to go to the **Incidents analysis** page where you can see more details about it. Click on **Manage incidents in new Incident hub**, to find the [Incident hub](diagnose-an-incident.md) page where you can find all incidents under the specific metric.
225
+
Select an incident to go to the **Incidents analysis** page where you can see more details about it. Select **Manage incidents in new Incident hub**, to find the [Incident hub](diagnose-an-incident.md) page where you can find all incidents under the specific metric.
227
226
228
227
## Subscribe anomalies for notification
229
228
230
-
If you'd like to get notified whenever an anomaly is detected, you can subscribe to alerts for the metric, using a hook. See [Configure alerts and get notifications using a hook](alerts.md) for more information.
231
-
229
+
If you'd like to get notified whenever an anomaly is detected, you can subscribe to alerts for the metric, using a hook. For more information, see [configure alerts and get notifications using a hook](alerts.md) for more information.
232
230
233
231
## Next steps
234
232
-[Configure alerts and get notifications using a hook](alerts.md)
0 commit comments