You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/use-cases/observability/clickstack/migration/elastic/migrating-data.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,7 +31,7 @@ Set up your data collection pipeline to send data to both Elastic and ClickStack
31
31
Configure Elastic's TTL settings to match your desired retention period. Set up the ClickStack [TTL](/use-cases/observability/clickstack/production#configure-ttl) to maintain data for the same duration.
32
32
33
33
3.**Validate and Compare**:
34
-
34
+
<br/>
35
35
- Run queries against both systems to ensure data consistency
36
36
- Compare query performance and results
37
37
- Migrate dashboards and alerts to ClickStack. This is currently a manual process.
@@ -506,7 +506,7 @@ ORDER BY (`host.name`, `@timestamp`)
506
506
507
507
Note that:
508
508
509
-
-We've used Tuples to represent nested structures instead of dot notation
509
+
-Tuples are used to represent nested structures instead of dot notation
510
510
- Used appropriate ClickHouse types based on the mapping:
511
511
-`keyword` → `String`
512
512
-`date` → `DateTime`
@@ -523,9 +523,9 @@ Note that:
523
523
This strict schema has a number of benefits:
524
524
525
525
-**Data validation** – enforcing a strict schema avoids the risk of column explosion, outside of specific structures.
526
-
- **Avoids risk of column explosion** - Although the JSON type scales to potentially thousands of columns, where subcolumns are stored as dedicated columns, this can lead to a column file explosion where an excessive number of column files are created that impacts performance. To mitigate this, the underlying [Dynamic type](/sql-reference/data-types/dynamic) used by JSON offers a [`max_dynamic_paths`](/sql-reference/data-types/newjson#reading-json-paths-as-sub-columns) parameter, which limits the number of unique paths stored as separate column files. Once the threshold is reached, additional paths are stored in a shared column file using a compact encoded format, maintaining performance and storage efficiency while supporting flexible data ingestion. Accessing this shared column file is, however, not as performant. Note, however, that the JSON column can be used with [type hints](/integrations/data-formats/json/schema#using-type-hints-and-skipping-paths). "Hinted" columns will deliver the same performance as dedicated columns.
526
+
- **Avoids risk of column explosion**: although the JSON type scales to potentially thousands of columns, where subcolumns are stored as dedicated columns, this can lead to a column file explosion where an excessive number of column files are created that impacts performance. To mitigate this, the underlying [Dynamic type](/sql-reference/data-types/dynamic) used by JSON offers a [`max_dynamic_paths`](/sql-reference/data-types/newjson#reading-json-paths-as-sub-columns) parameter, which limits the number of unique paths stored as separate column files. Once the threshold is reached, additional paths are stored in a shared column file using a compact encoded format, maintaining performance and storage efficiency while supporting flexible data ingestion. Accessing this shared column file is, however, not as performant. Note, however, that the JSON column can be used with [type hints](/integrations/data-formats/json/schema#using-type-hints-and-skipping-paths). "Hinted" columns will deliver the same performance as dedicated columns.
527
527
-**Simpler introspection of paths and types** - Although the JSON type supports [introspection functions](/sql-reference/data-types/newjson#introspection-functions) to determine the types and paths that have been inferred, static structures can be simpler to explore e.g. with `DESCRIBE`.
528
-
528
+
<br/>
529
529
Alternatively, users can simply create a table with one `JSON` column.
0 commit comments