Skip to content

Commit 841e2c2

Browse files
committed
Integrates additional resource links into main page content
1 parent 2ee8c59 commit 841e2c2

File tree

2 files changed

+33
-38
lines changed

2 files changed

+33
-38
lines changed

manage-data/migrate.md

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -126,18 +126,23 @@ Restoring from a snapshot is often the fastest and most reliable way to migrate
126126

127127
System indices can be restored by including their corresponding [feature states](/deploy-manage/tools/snapshot-and-restore.md#feature-state) in the restore operation, allowing you to retain internal configurations related to security, {{kib}}, or other stack features.
128128

129-
This method is especially useful when you want to fully replicate the source cluster or when remote reindexing is not possible, for example if the source cluster is in a degraded or unreachable state.
129+
This method is especially useful when:
130130

131-
To use this method, the new cluster must have access to the snapshot repository that contains the data from the old cluster. Also ensure that both clusters use [compatible versions](/deploy-manage/tools/snapshot-and-restore.md#snapshot-compatibility).
131+
* You want to fully replicate the source cluster or when remote reindexing is not possible, for example if the source cluster is in a degraded or unreachable state.
132+
* Your old cluster contains mostly static data, allowing you to snapshot the source cluster, restore in the new cluster, and continue operations.
132133

133-
For more information, refer to [Restore into a different cluster](/deploy-manage/tools/snapshot-and-restore/restore-snapshot.md#restore-different-cluster)
134+
When your source cluster is actively ingesting data, such as logs, metrics, or traces, and you need a seamless migration with minimal downtime, consider using the [minimal downtime migration](migrate/migrate-data-between-elasticsearch-clusters-with-minimal-downtime.md).
135+
136+
### Requirements [ec-restore-snapshots-requirements]
137+
* The new cluster must have access to the snapshot repository that contains the data from the old cluster.
138+
* Both clusters must use [compatible versions](/deploy-manage/tools/snapshot-and-restore.md#snapshot-compatibility).
139+
140+
For more information, refer to [Restore into a different cluster](/deploy-manage/tools/snapshot-and-restore/restore-snapshot.md#restore-different-cluster).
134141

135142
::::{note}
136-
For {{ece}} users, while it is most common to have Amazon S3 buckets, you should be able to restore from any addressable external storage that has your {{es}} snapshots.
143+
For {{ece}}, Amazon S3 us the most common snapshot storage, but you can restor from any accesible external storage that contains your {{es}} snapshots.
137144
::::
138145

139-
The following steps assume you already have a snapshot repository configured in the old cluster, with at least one valid snapshot containing the data you want to migrate. While these steps are valid in general, they assume that the migration is from a cluster containing mostly "static" data. In other words, they assume that it is possible to take a snapshot of the source (old) cluster, restore it in the target (new) cluster, and move on with operations. In use-cases in which the source cluster is consistently being used for data ingestion -for instance, to ingest time-series data such as logs, metrics, and traces- and the migration needs to be as transparent as possible, a minimal downtime approach can be of great help. More information is available in a [dedicated section](migrate/migrate-data-between-elasticsearch-clusters-with-minimal-downtime.md).
140-
141146
### Step 1: Set up the repository in the new cluster [migrate-repo-setup]
142147

143148
In this step, you’ll configure a snapshot repository in the new cluster that points to the storage location used by the old cluster. This allows the new cluster to access and restore snapshots created in the original environment.

manage-data/migrate/migrate-data-between-elasticsearch-clusters-with-minimal-downtime.md

Lines changed: 22 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -19,21 +19,29 @@ Migrating with incremental snapshots is useful when you want to:
1919
* Maintain data consistency and minimize disruption.
2020

2121
## How incremental snapshots work [how-incremental-snapshots-work]
22-
Incremental snapshots capture only the data that has changed since the previous snapshot.
22+
Incremental snapshots save only the data that has changed since the last snapshot. The first snapshot is a full copy of the data. Each subsequent snapshot contains only the differences, which makes creating and restoring snapshots faster and more efficient over time.
2323

24-
After the initial full snapshot, each subsequent snapshot contains only the differences, which makes the snapshot process faster over time. When you restore snapshots, only the missing data segments are copied from the snapshot repository to the cluster local storage, speeding up restores when the changes between snapshots are small.
24+
When restoring, {{es}} copies only the missing data segments from the snapshot repository to the new cluster local storage. When the changes between snapshots are small, the restore process is significantly faster.
2525

26-
When you incrementally create and restore snapshots, you can repeatedly synchronize the new cluster with the old cluster by taking and restoring multiple snapshots before performing the final cutover. This mechanism enables you to copy the vast majority of your data into the new cluster ahead of time, making the future transition from the old cluster to your new one as quick as possible, since only few segments will need to go through the snapshot-and-restore procedure upon cutover.
26+
By taking and restoring incremental snapshots in sequence, you can keep a new cluster closely synchronized with the old cluster, allowing you to migrate most of your data ahead of time and minimize downtime during the final cutover.
2727

28-
## Incremental snapshot limitations [incremental-snapshot-limitations]
29-
While incremental snapshots allow efficient migration with minimal downtime, consider the limitations when planning your migration.
28+
For more information about migrating your data with snapshot and restore, check [Snapshot and restore](/deploy-manage/tools/snapshot-and-restore.md).
3029

31-
Limitations include the following:
32-
* **Storage requirements** – Sufficient repository storage is required, and usage can grow based on snapshot frequency and data volume.
33-
* **Network overhead** – Transferring snapshots across networks, regions, or providers can be time-consuming and incur costs.
34-
* **Version compatibility** – Old and new clusters must use compatible {{es}} versions. To check if your cluster versions are compatible, check [Snapshot version compatibility](/deploy-manage/tools/snapshot-and-restore.md#snapshot-restore-version-compatibility).
35-
* **Custom integrations** – Some custom integrations that directly use the {{es}} API, such as the [Elasticsearch Java Client library](elasticsearch-java://reference/index.md), can require additional handling during the cutover from the old cluster to the new cluster.
36-
* **Resource usage** – Initial and incremental snapshot and restore operations can be resource-intensive, potentially affecting cluster performance.
30+
## Before you begin [incremental-snapshots-before-you-begin]
31+
Before you migrate, review the prerequisites and requirements.
32+
33+
### Prerequisites
34+
* Learn how to [set up and manage snapshot repositories](/deploy-manage/tools/snapshot-and-restore/manage-snapshot-repositories.md).
35+
* If restoring to a different cluster, review [Restore to a different cluster](/deploy-manage/tools/snapshot-and-restore/restore-snapshot.md#restore-different-cluster).
36+
* As an alternative migration method, you can [reindex from a remote cluster](/manage-data/migrate.md#ech-reindex-remote).
37+
38+
### Requirements
39+
* **Cluster size** – The new cluster must be the same size or larger than the old cluster.
40+
* **Version compatibility** – Both clusters must use compatible {{es}} versions. To check if your cluster versions are compatible, check [Snapshot version compatibility](/deploy-manage/tools/snapshot-and-restore.md#snapshot-restore-version-compatibility).
41+
* **Storage requirements** - Ensure sufficient repository storage. Usage grows with snapshot frequency and data volume.
42+
* **Network overhead** – Transferring snapshots across networks, regions, or providers can be time consuming and incur costs.
43+
* **Resource usage** – Snapshot and restore operations can be resource intensive and affect cluster performance.
44+
* **Custom integrations** – Some integrations that use the {{es}} API directly, such as the [Elasticsearch Java Client library](elasticsearch-java://reference/index.md), can require additional handling during cutover.
3745

3846
## Recommended migration timeline [recommended-migration-timeline]
3947
Tp complete the migration with minimal downtime, use incremental snapshots. While the exact sequence may differ depending on your infrastructure and operational requirements, you can use the recommended migration timeline as a reliable baseline that you can adapt. Adjust the steps and times to fit your own operational needs.
@@ -42,29 +50,11 @@ Tp complete the migration with minimal downtime, use incremental snapshots. Whil
4250
2. **09:30**: Restore the snapshot to the new cluster.
4351
3. **09:55**: Take another snapshot of the old cluster and restore it to the new cluster. Repeat this process until the snapshot and restore operations take only a few seconds or minutes.
4452
4. **10:15**: Perform the final cutover.
45-
1. In the old cluster, pause indexing or set indices to read-only.
53+
1. In the old cluster, pause indexing or set indices to read-only. For details on setting indices to read-only to safely pause indexing during migration, check [Index lifecycle actions: Read-only](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-readonly.md).
4654
2. Take a final snapshot.
4755
3. Restore the snapshot to the new cluster.
4856
4. Change ingestion and querying to the new cluster.
4957
5. Open the indices in the new cluster.
5058

51-
## Related resources [related-incremental-snapshot-resources]
52-
For more information on migrating {{es}} data with minimal downtime using incremental snapshots, review the related resources.
53-
54-
### Snapshot and restore
55-
* For more information about snapshot and restore concepts, check [Snapshot and restore](/deploy-manage/tools/snapshot-and-restore.md).
56-
* To learn how to configure snapshot repositories before taking or restoring snapshots, check [Manage snapshot repositories](/deploy-manage/tools/snapshot-and-restore/manage-snapshot-repositories.md).
57-
* To learn how to restore snapshots to clusters other than the source, check [Restore to a different cluster](/deploy-manage/tools/snapshot-and-restore/restore-snapshot.md#restore-different-cluster).
58-
59-
### Cluster and index management
60-
* For details on setting indices to read-only to safely pause indexing during migration, check [Index lifecycle actions: Read-only](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-readonly.md).
61-
62-
### Data ingestion
63-
* For information about using {{ls}} for data ingestion, check the [{{ls}} documentation](logstash://reference/index.md).
64-
* For information about using {{beats}} for data ingestion, check the [{{beats}} documentation](beats://reference/index.md).
65-
66-
### Alternative migration methods
67-
* To learn about reindexing from remote clusters as an alternative migration method, check [Reindex from a remote cluster](/manage-data/migrate.md#ech-reindex-remote).
68-
69-
### Additional support
70-
* To get expert assistance for your {{es}} migrations, go to [Elastic Professional Services](https://www.elastic.co/consulting).
59+
## Additional support [incremental-snapshots-additional-support]
60+
To get expert assistance for your {{es}} migrations, go to [Elastic Professional Services](https://www.elastic.co/consulting).

0 commit comments

Comments
 (0)