-
Notifications
You must be signed in to change notification settings - Fork 228
DOCS-448 - Cloud SIEM normalization #4677
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 31 commits
Commits
Show all changes
32 commits
Select commit
Hold shift + click to select a range
92be52d
First draft
jpipkin1 ba2b97c
Small updates
jpipkin1 b080c63
Add section on obtaining normalization data
jpipkin1 2c69ea9
Add links
jpipkin1 03d7f6e
Merge branch 'main' into docs-448-normalization
jpipkin1 fe6019d
Update docs/cse/records-signals-entities-insights/configure-entity-lo…
jpipkin1 40a9c51
Update vmware-vrealize-log-insight.md (#4681)
JV0812 ff2ac5b
Azure Flexible DB for MySQL Document (#4665)
sachin-sumologic 4282de2
Usage management - Advanced tab information added (#4641)
JV0812 5740bb2
OpenTelemetry Remote Management V2 (#4482)
JV0812 254210a
Azure web app server farm doc changes (#4684)
ankurch627 1cd38d6
SUMO-248960 | We got to know that when collecting metrics via mongos …
sumoanema 8a26e24
Scan Budgets Release notes_Pull back (#4696)
JV0812 be4b5b3
Update API intro reuse file (#4691)
jpipkin1 0b7c0b9
Zendesk App doc (#4689)
JV0812 35bd57d
LastPass app docs (#4690)
JV0812 d67277f
Change release note dates for LastPass and Zendesk (#4698)
jpipkin1 24f543d
DOCS-206 - Deprecate Root Cause Explorer (#4697)
jpipkin1 b001828
Update the app docs with version revert info (#4507)
JV0812 9ddbf05
Update minute-volume.md (#4692)
JV0812 142eca6
Changes in oracle otel app for addition of metric collection, metric …
sumoanema a3cf299
Added the new field (#4704)
rishav-sumo-dev 759fcf9
CrowdStrike Spotlight app docs (#4695)
JV0812 9ddea3b
Update aws-cloudtrail.md (#4703)
JV0812 9f1b84b
Added "Show optimization tips" button information (#4683)
JV0812 318743b
Rename image file
jpipkin1 3eddc60
Test
jpipkin1 6382f8e
Cleanup
jpipkin1 72964a1
Add borders to images
jpipkin1 2801173
Merge branch 'main' into docs-448-normalization
jpipkin1 666da8a
Entity looup table cleanup
jpipkin1 0e2aa9e
Update docs/cse/administration/save-inventory-data-lookup-table.md
jpipkin1 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -32,15 +32,15 @@ The key-value pairs are input to the next step of the process: mapping. | |
|
|
||
| ## Map message fields to schema attributes | ||
|
|
||
| The mapping process creates a Record from the key-value pairs that were extracted from a message, and maps a subset of the keys to Cloud SIEM schema attributes. | ||
| The [mapping process](/docs/cse/schema/create-structured-log-mapping/) creates a Record from the key-value pairs that were extracted from a message, and maps a subset of the keys to Cloud SIEM schema attributes. | ||
|
|
||
| Mapping solves a particular problem: messages from different products use different names to identify users, applications, devices and so on. For example, some messages may refer to a source IP address as `sourceIP`, while others use `sourceIpAddress`. We need a standard set of names for the data that most messages are likely to contain. The [Cloud SIEM schema](/docs/cse/schema) defines that standard set of names. | ||
|
|
||
| What’s the benefit of mapping? It results in Records that use a common (standard) name for fields that hold the same sort of data, regardless of the source of the incoming message. The result: the same Cloud SIEM rule can be applied to all Records, regardless of the message source. | ||
|
|
||
| ## Normalize usernames and hostnames | ||
|
|
||
| Username and hostname normalization is the process of transforming the value of Record attributes that contain usernames and hostnames into a standard format. The normalized value replaces the non-normalized value in a Record. The non-normalized values of hostname and usernames are retained in a `_raw` field in the Record. | ||
| [Username and hostname normalization](/docs/cse/schema/username-and-hostname-normalization/) is the process of transforming the value of Record attributes that contain usernames and hostnames into a standard format. The normalized value replaces the non-normalized value in a Record. The non-normalized values of hostname and usernames are retained in a `_raw` field in the Record. | ||
|
|
||
| Why normalize? Assume Cloud SIEM receives messages with an email-type field "[email protected]" and username-type field "bob". We can use normalization to transform "[email protected]" to "bob", allowing the username and email to be correlated together. | ||
|
|
||
|
|
||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.