Skip to content

Commit bb46a52

Browse files
committed
Refine content
1 parent 2a04e12 commit bb46a52

File tree

1 file changed

+18
-37
lines changed

1 file changed

+18
-37
lines changed
Lines changed: 18 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
navigation_title: Migrate with {{ls}}
2+
navigation_title: {{ech}} data to {{serverless-full}} with {{ls}}
33
applies_to:
44
stack: ga
55
deployment:
@@ -13,26 +13,19 @@ products:
1313
- id: cloud-kubernetes
1414
---
1515

16-
# Migrate data with {{ls}} [migrate-with-ls]
16+
# Migrate {{ech}} data to {{serverless-full}} with {{ls}} [migrate-with-ls]
1717

1818
You can use {{ls}} to migrate data from an {{ech}} deployment to an {{serverless-full}} project.
19-
20-
The Logstash input has cursor like-functionality that keeps your place.
21-
22-
[Tracking a field's value across runs](https://www.elastic.co/docs/reference/logstash/plugins/plugins-inputs-elasticsearch)
23-
2419
Familiarity with {{ech}}, {{es}}, and {{ls}} is helpful, but not required.
2520

26-
:::{note}
27-
This guide focuses on data migration. Dashboards, visualizations, pipelines, templates, and other {{kib}} assets must be migrated separately using the {{kib}} [export/import APIs](https://www.elastic.co/docs/api/doc/kibana/group/endpoint-saved-objects) or recreated manually.
21+
:::{admonition} Basic migration
22+
This guide focuses on a basic data migration scenario for moving static data from an {{ech}} deployment to a {{serverless-full}} project. Dashboards, visualizations, pipelines, templates, and other {{kib}} assets must be migrated separately using the {{kib}} [export/import APIs](https://www.elastic.co/docs/api/doc/kibana/group/endpoint-saved-objects) or recreated manually.
2823
:::
2924

3025
## Prerequisites [migrate-prereqs]
3126

32-
Ensure that you have:
33-
3427
- {{ech}} deployment with data to migrate
35-
- {{serverless-full}} project configured and running
28+
- [{{serverless-full}}](/deploy-manage/deploy/elastic-cloud/serverless.md) project configured and running
3629
- {{ls}} [installed](https://www.elastic.co/downloads/logstash) on your local machine or server
3730
- API keys in {{ls}} format for authentication with both deployments
3831

@@ -43,9 +36,8 @@ Ensure that you have:
4336
* [Verify data migration](#verify-migration)
4437

4538

46-
4739
## Step 1: Configure {{ls}} [configure-ls]
48-
Create a new {{ls}} configuration file (migration.conf) with these settings:
40+
Create a new {{ls}} [pipeline configuration file](logstash://reference/creating-logstash-pipeline.md) (_migration.conf_) with these settings:
4941

5042
```
5143
input {
@@ -62,15 +54,20 @@ output {
6254
hosts => [ "https://<SERVERLESS_HOST_URL>:443" ] # URL for your Serverless project URL, set port as 443
6355
api_key => "<SERVERLESS_API_KEY>" # API key (in Logstash format) for your Serverless project
6456
ssl_enabled => true
65-
index => "%{[@metadata][input][elasticsearch][_index]}" # Retain original index names
57+
index => "%{[@metadata][input][elasticsearch][_index]}" # Instruction to retain original index names
6658
}
6759
6860
stdout { codec => rubydebug { metadata => true } }
6961
}
7062
```
7163

72-
When you create an API key for Logstash, be sure to select **Logstash** from the **API key** format dropdown. This option formats the API key in the correct `id:api_key` format required by Logstash.
64+
:::{admonition} Tips
7365

66+
- When you create an [API key for {{ls}}](logstash://reference/connecting-to-serverless.md#api-key), be sure to select **Logstash** from the **API key** format dropdown. This option formats the API key in the correct `id:api_key` format required by {{ls}}.
67+
68+
- To migrate multiple indexes at the same time, use a wildcard in the index name.
69+
For example, `index => "logs-*"` migrates all indices starting with `logs-`.
70+
:::
7471

7572
## Step 2: Run {{ls}} [run-ls]
7673

@@ -88,27 +85,11 @@ After running {{ls}}, verify that the data has been successfully migrated:
8885
2. Navigate to Index Management and select the index.
8986
3. Verify that the migrated data is visible.
9087

88+
<br>
89+
:::{admonition} Advanced migration
90+
:applies_to: stack: preview
9191

92+
{{ls}} can handle more advanced migrations with field tracking settings in the elasticsearch input. The field tracking feature adds "cursor-like" functionality that can support more complex migrations and ongoing data migration over time.
9293

93-
94-
95-
:::{tip}
96-
To migrate multiple indexes at the same time, use a wildcard in the index name.
97-
For example, `index => "logs-*"` migrates all indices starting with `logs-`.
94+
More information is available in the Elasticsearch input plugin documentation: [Tracking a field's value across runs](https://www.elastic.co/docs/reference/logstash/plugins/plugins-inputs-elasticsearch#plugins-inputs-elasticsearch-cursor).
9895
:::
99-
100-
101-
102-
## More resources [more-resources]
103-
* https://www.elastic.co/docs/reference/logstash/plugins/plugins-inputs-elasticsearch
104-
* https://www.elastic.co/docs/reference/logstash/plugins/plugins-inputs-elasticsearch#plugins-inputs-elasticsearch-cursor
105-
* [API key in LS format](https://www.elastic.co/docs/reference/logstash/connecting-to-serverless#api-key)
106-
107-
108-
109-
110-
## FAQ
111-
112-
ToDo @karenzone: Continue with FAQ
113-
114-

0 commit comments

Comments
 (0)