You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/sentinel/monitor-data-connector-health.md
+23-15Lines changed: 23 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,11 +13,11 @@ ms.author: yelevin
13
13
14
14
[!INCLUDE [Banner for top of topics](./includes/banner.md)]
15
15
16
-
After you've configured and connected your Azure Sentinel workspace to your workspace, you'll want to monitor your connector health, viewing any service or data source issues, such as authentication, throttling, and more.
16
+
After you've configured and connected your Microsoft Sentinel workspace to your workspace, you'll want to monitor your connector health, viewing any service or data source issues, such as authentication, throttling, and more.
17
17
18
18
You also might like to configure notifications for health drifts for relevant stakeholders who can take action. For example, configure email messages, Microsoft Teams messages, new tickets in your ticketing system, and so on.
19
19
20
-
This article describes how to use the following features, which allow you to keep track of your data connectors' health, connectivity, and performance from within Azure Sentinel:
20
+
This article describes how to use the following features, which allow you to keep track of your data connectors' health, connectivity, and performance from within Microsoft Sentinel:
21
21
22
22
-**Data connectors health monitoring workbook**. This workbook provides additional monitors, detects anomalies, and gives insight regarding the workspace’s data ingestion status. You can use the workbook’s logic to monitor the general health of the ingested data, and to build custom views and rule-based alerts.
23
23
@@ -27,6 +27,7 @@ This article describes how to use the following features, which allow you to kee
27
27
> The *SentinelHealth* data table is currently supported only for selected data connectors. For more information, see [Supported data connectors](#supported-data-connectors).
28
28
>
29
29
30
+
30
31
## Use the health monitoring workbook
31
32
32
33
1. From the Microsoft Sentinel portal, select **Workbooks** from the **Threat management** menu.
@@ -41,9 +42,9 @@ This article describes how to use the following features, which allow you to kee
41
42
42
43
There are three tabbed sections in this workbook:
43
44
44
-
1. The **Overview** tab shows the general status of data ingestion in the selected workspace: volume measures, EPS rates, and time last log received.
45
+
- The **Overview** tab shows the general status of data ingestion in the selected workspace: volume measures, EPS rates, and time last log received.
45
46
46
-
1. The **Data collection anomalies** tab will help you to detect anomalies in the data collection process, by table and data source. Each tab presents anomalies for a particular table (the **General** tab includes a collection of tables). The anomalies are calculated using the **series_decompose_anomalies()** function that returns an **anomaly score**. [Learn more about this function](/azure/data-explorer/kusto/query/series-decompose-anomaliesfunction?WT.mc_id=Portal-fx). Set the following parameters for the function to evaluate:
47
+
- The **Data collection anomalies** tab will help you to detect anomalies in the data collection process, by table and data source. Each tab presents anomalies for a particular table (the **General** tab includes a collection of tables). The anomalies are calculated using the **series_decompose_anomalies()** function that returns an **anomaly score**. [Learn more about this function](/azure/data-explorer/kusto/query/series-decompose-anomaliesfunction?WT.mc_id=Portal-fx). Set the following parameters for the function to evaluate:
47
48
48
49
-**AnomaliesTimeRange**: This time picker applies only to the data collection anomalies view.
49
50
-**SampleInterval**: The time interval in which data is sampled in the given time range. The anomaly score is calculated only on the last interval's data.
@@ -52,7 +53,7 @@ There are three tabbed sections in this workbook:
1. The **Agent info** tab shows you information about the health of the Log Analytics agents installed on your various machines, whether Azure VM, other cloud VM, on-premises VM, or physical. You can monitor the following:
56
+
- The **Agent info** tab shows you information about the health of the Log Analytics agents installed on your various machines, whether Azure VM, other cloud VM, on-premises VM, or physical. You can monitor the following:
56
57
57
58
- System location
58
59
@@ -68,14 +69,19 @@ There are three tabbed sections in this workbook:
68
69
69
70
## Use the SentinelHealth data table (Public preview)
70
71
71
-
To get data connector health data from the *SentinelHealth* data table, you must first [turn on the Azure Sentinel health feature](#turn-on-azure-sentinel-health-for-your-workspace) for your workspace.
72
+
To get data connector health data from the *SentinelHealth* data table, you must first [turn on the Microsoft Sentinel health feature](#turn-on-azure-sentinel-health-for-your-workspace) for your workspace.
72
73
73
74
Once the health feature is turned on, the *SentinelHealth* data table is created at the first success or failure event generated for your data connectors.
74
75
75
76
> [!TIP]
76
77
> To configure the retention time for your health events, see the [Log Analytics retention configuration documentation](/azure/azure-monitor/logs/manage-cost-storage).
77
78
>
78
79
80
+
> [!IMPORTANT]
81
+
>
82
+
> The SentinelHealth data table is currently in **PREVIEW**. See the [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/) for additional legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability.
83
+
>
84
+
79
85
### Supported data connectors
80
86
81
87
The *SentinelHealth* data table is currently supported only for the following data connectors:
@@ -87,9 +93,9 @@ The *SentinelHealth* data table is currently supported only for the following da
### Turn on Azure Sentinel health for your workspace
96
+
### Turn on Microsoft Sentinel health for your workspace
91
97
92
-
1. In Azure Sentinel, under the **Configuration** menu on the left, select **Settings** and expand the **Health** section.
98
+
1. In Microsoft Sentinel, under the **Configuration** menu on the left, select **Settings** and expand the **Health** section.
93
99
94
100
1. Select **Configure Diagnostic Settings** and create a new diagnostic setting.
95
101
@@ -106,7 +112,7 @@ The *SentinelHealth* data table is created at the first success or failure event
106
112
107
113
### Access the *SentinelHealth* table
108
114
109
-
In the Azure Sentinel **Logs** page, run a query on the *SentinelHealth* table. For example:
115
+
In the Microsoft Sentinel **Logs** page, run a query on the *SentinelHealth* table. For example:
110
116
111
117
```kusto
112
118
SentinelHealth
@@ -121,7 +127,7 @@ The following types of health events are logged in the *SentinelHealth* table:
121
127
122
128
If the data connector's status changes, either from a success to failure, from failure to success, or has changes in failure reasons, the event is logged immediately to allow your team to take proactive and immediate action.
123
129
124
-
Potentially transient errors, such as source service throttling, are logged only after they've continued for more than 60 minutes. These 60 minutes allow Azure Sentinel to overcome a transient issue in the backend and catch up with the data, without requiring any user action. Errors that are definitely not transient are logged immediately.
130
+
Potentially transient errors, such as source service throttling, are logged only after they've continued for more than 60 minutes. These 60 minutes allow Microsoft Sentinel to overcome a transient issue in the backend and catch up with the data, without requiring any user action. Errors that are definitely not transient are logged immediately.
125
131
126
132
-**Failure summary**. Logged once an hour, per connector, per workspace, with an aggregated failure summary. Failure summary events are created only when the connector has experienced polling errors during the given hour. They contain any extra details provided in the *ExtendedProperties* column, such as the time period for which the connector's source platform was queried, and a distinct list of failures encountered during the time period.
127
133
@@ -186,11 +192,11 @@ lastestStatus
186
192
187
193
### Configure alerts and automated actions for health issues
188
194
189
-
While you can use the Azure Sentinel [analytics rules](automate-incident-handling-with-automation-rules.md) to configure automation in Azure Sentinel logs, if you want to be notified and take immediate action for health drifts in your data connectors, we recommend that you use [Azure Monitor alert rules](/azure/azure-monitor/alerts/alerts-overview).
195
+
While you can use the Microsoft Sentinel [analytics rules](automate-incident-handling-with-automation-rules.md) to configure automation in Microsoft Sentinel logs, if you want to be notified and take immediate action for health drifts in your data connectors, we recommend that you use [Azure Monitor alert rules](/azure/azure-monitor/alerts/alerts-overview).
190
196
191
197
For example:
192
198
193
-
1. In an Azure Monitor alert rule, select your Azure Sentinel workspace as the rule scope, and **Custom log search** as the first condition.
199
+
1. In an Azure Monitor alert rule, select your Microsoft Sentinel workspace as the rule scope, and **Custom log search** as the first condition.
194
200
195
201
1. Customize the alert logic as needed, such as frequency or lookback duration, and then use [queries](#run-queries-to-detect-health-drifts) to search for health drifts.
196
202
@@ -204,18 +210,20 @@ The following table describes the columns and data generated in the *SentinelHea
|**TenantId**| String | The tenant ID for your Azure Sentinel workspace. |
213
+
|**TenantId**| String | The tenant ID for your Microsoft Sentinel workspace. |
208
214
|**TimeGenerated**| Datetime | The time at which the health event occurred. |
209
215
| <aname="operationname"></a>**OperationName**| String | The health operation. One of the following values: <br><br>-`Data fetch status change` for health or success indications <br>- `Failure summary` for aggregated health summaries. <br><br>For more information, see [Understanding SentinelHealth table events](#understanding-sentinelhealth-table-events). |
210
-
| <aname="sentinelresourceid"></a>**SentinelResourceId**| String | The unique identifier of the Azure Sentinel workspace and the associated connector on which the health event occurred. |
216
+
| <aname="sentinelresourceid"></a>**SentinelResourceId**| String | The unique identifier of the Microsoft Sentinel workspace and the associated connector on which the health event occurred. |
211
217
|**SentinelResourceName**| String | The data connector name. |
212
218
| <aname="status"></a>**Status**| String | Indicates `Success` or `Failure` for the `Data fetch status change`[OperationName](#operationname), and `Informational` for the `Failure summary`[OperationName](#operationname). |
213
219
|**Description**| String | Describes the operation, including extended data as needed. For example, for failures, this column might indicate the failure reason. |
214
220
|**WorkspaceId**| String | The workspace GUID on which the health issue occurred. The full Azure Resource Identifier is available in the [SentinelResourceID](#sentinelresourceid) column. |
215
-
|**SentinelResourceType**| String |The Azure Sentinel resource type being monitored: `Data connector`|
221
+
|**SentinelResourceType**| String |The Microsoft Sentinel resource type being monitored: `Data connector`|
216
222
|**SentinelResourceKind**| String | The type of data connector being monitored, such as `Office365`. |
217
223
|**RecordId**| String | A unique identifier for the record that can be shared with the support team for better correlation as needed. |
218
224
|**ExtendedProperties**| Dynamic (json) | A JSON bag that varies by the [OperationName](#operationname) value and the [Status](#status) of the event: <br><br>- For `Data fetch status change` events with a success indicator, the bag contains a ‘DestinationTable’ property to indicate where data from this connector is expected to land. For failures, the contents vary depending on the failure type. |
219
225
|**Type**| String |`SentinelHealth`|
226
+
227
+
220
228
## Next steps
221
229
Learn how to [onboard your data to Microsoft Sentinel](quickstart-onboard.md), [connect data sources](connect-data-sources.md), and [get visibility into your data, and potential threats](get-visibility.md).
Copy file name to clipboardExpand all lines: articles/sentinel/whats-new.md
+12Lines changed: 12 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,6 +27,18 @@ If you're looking for items older than six months, you'll find them in the [Arch
27
27
>
28
28
> You can also contribute! Join us in the [Microsoft Sentinel Threat Hunters GitHub community](https://github.com/Azure/Azure-Sentinel/wiki).
29
29
30
+
## January 2022
31
+
32
+
-[SentinelHealth data table](#sentinel-health-data-table)
33
+
34
+
### SentinelHealth data table (Public preview)
35
+
36
+
Microsoft Sentinel now provides the **SentinelHealth** data table to help you monitor your connector health, providing insights on health drifts, such as latest failure events per connector, or connectors with changes from success to failure states. Use this data to create alerts and other automated actions, such as Microsoft Teams messages, new tickets in a ticketing system, and so on.
37
+
38
+
Turn on the Microsoft Sentinel health feature for your workspace in order to have the **SentinelHealth** data table created at the next success or failure event generated for supported data connectors.
39
+
40
+
For more information, see [Use the SentinelHealth data table (Public preview)](monitor-data-connector-health.md#use-the-sentinelhealth-data-table-public-preview).
41
+
30
42
## December 2021
31
43
32
44
-[IoT OT Threat Monitoring with Defender for IoT solution](#iot-ot-threat-monitoring-with-defender-for-iot-solution-public-preview)
0 commit comments