You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/sentinel/connect-cef-syslog-options.md
+3-4Lines changed: 3 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,13 +16,12 @@ In this article, you can find the relevant option for streaming and filtering lo
16
16
17
17
|Scenario |Options |
18
18
|---------|---------|
19
-
|Are your logs in raw Syslog, in Common Event Format (CEF), or both? |• [Syslog](connect-syslog.md)<br>• [CEF](connect-cef-ama.md)<br>• [CEF and Syslog](connect-cef-syslog.md)|
20
-
|Are you sending logs to Microsoft Sentinel directly from your device/appliance, or via a log forwarder? |**Send logs directly via CEF**:<br><br>• To send logs directly with the [new AMA connector](connect-cef-ama.md), skip the Configure a log forwarder step.<br> • To send logs directly via CEF with the [legacy connector](connect-common-event-format.md), skip the Designate a log forwarder and install the Log Analytics agent step.<br><br>**Send logs [directly via Syslog](connect-syslog.md)**<br><br>**[Configure a log forwarder](connect-log-forwarder.md)**|
21
-
|Are you sending logs using the new Azure Monitor agent (AMA) or the legacy Log Analytics agent? |**CEF**:<br>• [New AMA connector](connect-cef-ama.md)<br>• [Legacy agent](connect-common-event-format.md)<br><br>**Syslog**:<br>• To ingest logs over Syslog with the AMA, [create a DCR](../azure-monitor/essentials/data-collection-rule-structure.md).<br>• Ingest logs via the [legacy agent](connect-common-event-format.md). |
19
+
|Are your logs in raw Syslog, in Common Event Format (CEF), or both? |• **[CEF (with CEF AMA connector)](connect-cef-ama.md)**<br><br>• **Syslog**: To ingest logs over Syslog with the AMA, [create a DCR](../azure-monitor/essentials/data-collection-rule-structure.md), or for the full procedure, see [forward syslog data to Log Analytics using the AMA](forward-syslog-monitor-agent.md).<br><br>• **[CEF and Syslog](connect-cef-syslog.md)**|
20
+
|Are you sending logs to Microsoft Sentinel directly from your device/appliance, or via a log forwarder? |• To **[Send logs directly via CEF](connect-cef-ama.md)**, skip the Configure a log forwarder step.<br><br>• **[Send logs directly via Syslog](connect-syslog.md)**<br><br>• **[Configure a log forwarder](connect-log-forwarder.md)**|
22
21
23
22
## Next steps
24
23
25
-
In this article, you learned about the available options for streaming logs in the CEF and Syslog format to your Microsoft Sentinel workspace.
24
+
In this article, we reviewed the available options for streaming logs in the CEF and Syslog format to your Microsoft Sentinel workspace.
26
25
-[Stream CEF logs with the AMA connector](connect-cef-ama.md)
27
26
-[Collect data from Linux-based sources using Syslog](connect-syslog.md)
28
27
-[Stream logs in both the CEF and Syslog format](connect-cef-syslog.md)
Copy file name to clipboardExpand all lines: articles/sentinel/connect-cef-syslog.md
+7-6Lines changed: 7 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -35,18 +35,19 @@ Before you begin, verify that you have:
35
35
- To collect events from any system that isn't an Azure virtual machine, ensure that [Azure Arc](../azure-monitor/agents/azure-monitor-agent-manage.md) is installed.
36
36
- To ingest Syslog and CEF logs into Microsoft Sentinel, you can designate and configure a Linux machine that collects the logs from your devices and forwards them to your Microsoft Sentinel workspace. [Configure a log forwarder](connect-cef-ama.md#configure-a-log-forwarder)
37
37
38
-
## Separate your facilities
38
+
## Avoid data ingestion duplication
39
39
40
-
To avoid data duplication, make sure that the appliance that sends Syslog data and the appliance that sends CEF data do so on different facilities, for example `local1` and `local2`. Make sure that each DCR you configure in the next steps uses the relevant facility for CEF or Syslog respectively.
40
+
Using the same facility for both Syslog and CEF messages may result in data ingestion duplication between the CommonSecurityLog and Syslog tables.
41
41
42
-
- If you plan to use the same log forwarder machine to forward Syslog messages as well as CEF, to avoid the duplication of events to the Syslog and CommonSecurityLog tables: On each source machine that sends logs to the forwarder in CEF format, edit the Syslog configuration file to remove the facilities used to send CEF messages. This way, the facilities sent in CEF won't also be sent in Syslog.
43
-
- If changing the facility for the source appliance is not applicable, you can use ingest time transformations to filter out CEF messages from the Syslog stream to avoid duplication:
42
+
To avoid this scenario, use one of these methods:
43
+
44
+
-**If the source device enables configuration of the target facility**: On each source machine that sends logs to the log forwarder in CEF format, edit the Syslog configuration file to remove the facilities used to send CEF messages. This way, the facilities sent in CEF won't also be sent in Syslog. Make sure that each DCR you configure in the next steps uses the relevant facility for CEF or Syslog respectively.
45
+
-**If changing the facility for the source appliance isn't applicable**: Use an ingest time transformation to filter out CEF messages from the Syslog stream to avoid duplication:
44
46
45
47
```kusto
46
48
source |
47
49
where ProcessName !contains “\“CEF\””
48
50
```
49
-
50
51
## Create a DCR for your CEF logs
51
52
52
53
- Create the DCR via the UI:
@@ -55,7 +56,7 @@ To avoid data duplication, make sure that the appliance that sends Syslog data a
55
56
1. [Select the data source type and create the DCR](connect-cef-ama.md#select-the-data-source-type-and-create-the-dcr).
56
57
57
58
> [!IMPORTANT]
58
-
> Make sure to correctly [separate your facilities](#separate-your-facilities) (review the options in this section).
59
+
> Make sure to **[avoid data ingestion duplication](#avoid-data-ingestion-duplication)** (review the options in this section).
59
60
60
61
1. [Run the installation script](connect-cef-ama.md).
0 commit comments