Skip to content

Commit 348c7f0

Browse files
amee-sumoJV0812kimsauce
authored
Update Timestamp Autocorrection and Historical Data Ingestion Documen… (#5256)
* Update Timestamp Autocorrection and Historical Data Ingestion Documentation * Update collector-faq.md * Update docs/send-data/collector-faq.md Co-authored-by: Kim (Sumo Logic) <[email protected]> --------- Co-authored-by: Jagadisha V <[email protected]> Co-authored-by: Kim (Sumo Logic) <[email protected]>
1 parent 7bc1148 commit 348c7f0

File tree

2 files changed

+9
-3
lines changed

2 files changed

+9
-3
lines changed

docs/send-data/collector-faq.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -419,9 +419,15 @@ This article describes the assumptions that Sumo makes about customer data, tips
419419

420420
See [using _format for troubleshooting](/docs/send-data/reference-information/time-reference.md) timestamps.
421421

422-
#### Assumption: Data is less than 365 days old
422+
#### Assumption: Data is less than 30 days but within 365 days
423423

424-
Sumo Logic assumes that all log message times fall within a window of -1 year through +2 days compared to the current time. Any log messages with a parsed timestamp outside of that window is automatically re-stamped with the current time.
424+
* To ingest historical data older than 30 days but within 365 days, you must specify a `timestamp` field using a regex locator and a valid date format.
425+
426+
#### Assumption: Data is older than 365 days
427+
428+
Sumo Logic assumes that all log message times fall within a window of -1 year through +2 days compared to the current time. Any log messages with a parsed timestamp outside of that window are automatically re-stamped with the current time.
429+
* Data older than 365 days can still be ingested. However, even if a custom timestamp is provided, it will be autocorrected to the current time unless technical support disables this function at the organization level.
430+
* To ingest data older than 365 days with the original timestamp intact, you'll need to contact [Support](https://support.sumologic.com/support/s) to disable the autocorrection function at the org level.
425431
426432
#### Assumption: Data from a source will have similar timestamps
427433

docs/send-data/reference-information/time-reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ If your log messages from a Source contain multiple timestamps, timestamps in un
3333

3434
The Collector assumes that all log messages coming from a particular Source will have timestamps that are close together. If a message comes through that appears to be more than one day earlier or later than recent messages from that Source it will be auto-corrected to match the current time. You can stop this auto-correction by explicitly configuring a custom timestamp format on your Source.
3535

36-
The Collector also assumes that all log messages coming from a particular Source will have timestamps that are within a window of -1 year through +2 days compared to the current time. Any log message with a parsed timestamp outside of that window is automatically re-stamped with the current time. You must contact [Sumo Logic Support](https://support.sumologic.com/) to adjust this auto-correction behavior. See [How to ingest old or historical data](/docs/send-data/collector-faq#how-to-ingest-old-or-historical-data) for further details.
36+
The Collector also assumes that all log messages coming from a particular Source will have timestamps that are within a window of -1 year through +2 days compared to the current time. Any log messages with a timestamp older than 30 days is automatically set to the current time. You must contact [Sumo Logic Support](https://support.sumologic.com/) to adjust this auto-correction behavior. See [How to ingest old or historical data](/docs/send-data/collector-faq#how-to-ingest-old-or-historical-data) for further details.
3737

3838
### Automated timestamp parsing
3939

0 commit comments

Comments
 (0)