You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Timestamp Parsing**. You can configure timestamp parsing for logs ingested using this source template. For more information, see [Timestamps, Time Zones, and Date Formats for the OpenTelemetry collector](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/apache/index.md
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -77,7 +77,9 @@ In this step, you will configure the yaml required for Apache Collection. Below
77
77
-**Error file log path**. Enter the path to the error log file for your Apache instance.
78
78
-**Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default, sumo tags `_sourceCategory` with the value otel/apache user needs to provide the value for `webengine.cluster.name`.
79
79
80
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
80
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
81
+
82
+
<TimestampParsing/>
81
83
82
84
**Processing Rules**. You can add **processing rules** for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/docker/index.md
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -77,7 +77,9 @@ In this step, you will configure the yaml required for Docker Collection. Below
77
77
-**Excluded Image List**. A list of strings, [regexes](https://golang.org/pkg/regexp/), or [globs](https://github.com/gobwas/glob) whose referent container image names will not be among the queried containers for scrapping metrics. Learn more about [*excluded_images*](https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/receiver/dockerstatsreceiver/README.md#configuration).
78
78
-**Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default, Sumo Logic tags `_sourceCategory` with the value otel/docker.
79
79
80
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
80
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
81
+
82
+
<TimestampParsing/>
81
83
82
84
**Processing Rules**. You can add **processing rules** for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/elasticsearch/index.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -78,8 +78,9 @@ In this step, you will configure the yaml required for Elasticsearch collection.
78
78
-**Password Environment Variable Name**. Enter the Elasticsearch password environment variable name.
79
79
-**Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default, Sumo Logic tags `_sourceCategory` with the value otel/elasticsearch user needs to provide the value for `db.cluster.name`.
80
80
81
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
81
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
82
82
83
+
<TimestampParsing/>
83
84
84
85
**Processing Rules**. You can add **processing rules** for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/kafka/index.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -68,8 +68,9 @@ In this step, you will configure the yaml required for Kafka collection. Below a
68
68
-**Endpoint**. The URL of the broker endpoint (default: `localhost:9092`).
69
69
-**Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default, Sumo Logic tags `_sourceCategory` with the value otel/kafka user needs to provide the value for `webengine.cluster.name`.
70
70
71
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
71
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
72
72
73
+
<TimestampParsing/>
73
74
74
75
**Processing Rules**. You can add **processing rules** for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/localfile/index.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -55,8 +55,9 @@ In this step, you will configure the yaml required for Local File collection. Be
55
55
-**Collection should begin from**. Defines where will the collection of the logs start from. Possible values are "End of File" and "Beginning of File".
56
56
-**Detect messages spanning multiple lines**. You can enable this option when dealing with logs which span over multiple lines. On enabling this option you will need to specify **Boundary regex location** where you can specify if the expression defines end or start of the log line and **Expression to match message boundary** where you will define the expression.
57
57
58
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
58
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
59
59
60
+
<TimestampParsing/>
60
61
61
62
**Processing Rules**. You can add processing rules for logs collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/mysql/index.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -88,8 +88,9 @@ In this step, you will configure the yaml required for MySQL collection. Below a
88
88
- **Password Environment Variable Name**. Enter the MySQL password environment variable name.
89
89
- **Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default, Sumo Logic tags `_sourceCategory` with the value otel/mysql user needs to provide the value for`db.cluster.name`.
90
90
91
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
91
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
92
92
93
+
<TimestampParsing/>
93
94
94
95
**Processing Rules**. You can add **processing rules**for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/nginx/index.md
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -76,7 +76,9 @@ In this step, you will configure the yaml required for Nginx collection. Below a
76
76
-**Path to Nginx error Log file**. Enter the path to the error log file for your Nginx instance.
77
77
-**Fields/Metadata**. You can provide any customer fields to be tagged with the data collected. By default sumo tags `_sourceCategory` with the value otel/nginx user needs to provide the value for `webengine.cluster.name`.
78
78
79
-
**Timestamp Parsing**. You can do timestamp parsing for log ingested using this source template. For more details, refer to [Timestamps, Time Zones, and Date Formats](/docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference) for OpenTelemetry collector.
79
+
import TimestampParsing from '../../../../../reuse/apps/opentelemetry/timestamp-parsing.md';
80
+
81
+
<TimestampParsing/>
80
82
81
83
**Processing Rules**. You can add **processing rules** for logs/metrics collected. To learn more, refer to [Processing Rules](../../processing-rules/index.md).
Copy file name to clipboardExpand all lines: docs/send-data/opentelemetry-collector/remote-management/source-templates/otrm-time-reference.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@ description: Learn how Sumo Logic manages timestamps, time zones, and dates, and
5
5
keywords:
6
6
- time
7
7
- time reference
8
-
- time zone
8
+
- timezone
9
9
- time zone
10
10
---
11
11
@@ -15,13 +15,13 @@ import useBaseUrl from '@docusaurus/useBaseUrl';
15
15
16
16
We support several options for timestamps, time zones, time ranges, and dates. When collecting log data, the timestamp attached to messages is vital, both for the integrity of the data in your account, and for accurate query results.
17
17
18
-
Because of the importance of timestamps, Sumo Logicindexes the timestamp of each message, making sure that data relevant to a query’s time range is returned properly in search results, which allows you to reconstruct a correct event timeline.
18
+
When collecting log data, the timestamp attached to messages is critical for data integrity and accurate search results. Sumo Logicindexes the timestamp of each message to ensure results fall within the query’s time range, allowing you to reconstruct event timelines reliably.
19
19
20
20
## Timestamps
21
21
22
22
Timestamp is the part of a log message that marks the time that an event occurred. During ingestion, we can detect the message timestamp, convert it to Unix epoch time (the number of milliseconds since midnight, January 1, 1970 UTC), and index it. The timestamp is parsed either using the default timestamp parsing settings, or a custom format that you specify, including the time zone.
23
23
24
-
When configuring asource template, specify a custom format to parse timestamps in your log messages.
24
+
When configuring asource template, you can specify a custom format to parse timestamps in your log messages.
25
25
26
26
:::note
27
27
Currently, only `strptime` timestamps are supported in the source templates.
@@ -42,7 +42,7 @@ OpenTelemetry Collectors can automatically parse most timestamps without any is
42
42
43
43
1. Perform one of the following steps:
44
44
* If you're configuring a new Source template, proceed to Step 2. Or,
45
-
* To edit the timestamp settings for an existing Source template, navigate tothe source template. Then click on **Edit**, to the right of the Source name and go to Step 2.<br/><img src={useBaseUrl('img/send-data/source-template-edit.png')} alt="Screenshot showing the editing interface for a source template in Sumo Logic, highlighting the section for editing advanced options including timestamp settings" style={{border: '1px solid gray'}} width="400"/>
45
+
* To edit the timestamp settings for an existing Source template, navigate tothe source template. Then click **Edit** to the right of the Source name and go to Step 2.<br/><img src={useBaseUrl('img/send-data/source-template-edit.png')} alt="Screenshot showing the editing interface for a source template in Sumo Logic, highlighting the section for editing advanced options including timestamp settings" style={{border: '1px solid gray'}} width="400"/>
46
46
1. Navigate to the **Timestamp Parsing** section and select **Specify the format** and enter the below details:
47
47
1.**Select Timezone**. Define the geographic location (time zone) to use while parsing a timestamp that does not include a time zone. The available locations depend on the local IANA Time Zone database. For example, `America/New_York`. For more examples, refer to the [List of tz database time zones](https://en.wikipedia.org/wiki/List_of_tz_database_time_zones).
48
48
1.**Format**. Specify the exact layout of the timestamp to be parsed. For example, `- %Y-%m-%dT%H:%M:%S.%LZ`. To learn more about the formatting rules, refer to [this guide](https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/internal/coreinternal/timeutils/internal/ctimefmt/ctimefmt.go#L68).
@@ -142,7 +142,7 @@ The following conventions are some examples of the supported formats for `strpti
142
142
143
143
The following considerations apply to time zones:
144
144
145
-
We highly recommend that the time zone be set explicitly on any source template where the logs does not have a time zone available. Sumo Logic always attempts to determine the time zone for the Source. However, if that is not possible, the time zone will revert to UTC. In these cases, the time zone will be incorrect, and that could significantly affect forensic analysis and reporting.
145
+
We highly recommend that the time zone be set explicitly on any source template where the logs do not have a time zone available. Sumo Logic always attempts to determine the time zone for the Source. However, if that is not possible, the time zone will revert to UTC. In these cases, the time zone will be incorrect, and that could significantly affect forensic analysis and reporting.
0 commit comments