You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Aug 16, 2022. It is now read-only.
Copy file name to clipboardExpand all lines: docs/elasticsearch/snapshot-restore.md
+22-22Lines changed: 22 additions & 22 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,17 +7,17 @@ nav_order: 30
7
7
8
8
# Take and restore snapshots
9
9
10
-
Snapshots are backups of a cluster's indices and *state*. State includes cluster settings, node information, index settings, and shard allocation.
10
+
Snapshots are backups of a cluster's indices and state. State includes cluster settings, node information, index settings, and shard allocation.
11
11
12
12
Snapshots have two main uses:
13
13
14
-
- Recovering from failure
14
+
-**Recovering from failure**
15
15
16
16
For example, if cluster health goes red, you might restore the red indices from a snapshot.
17
17
18
-
- Migrating from one cluster to another
18
+
-**Migrating from one cluster to another**
19
19
20
-
For example, if you are moving from a proof-of-concept to a production cluster, you might take a snapshot of the former and restore it on the latter.
20
+
For example, if you're moving from a proof-of-concept to a production cluster, you might take a snapshot of the former and restore it on the latter.
21
21
22
22
23
23
---
@@ -31,7 +31,7 @@ Snapshots have two main uses:
31
31
32
32
## About snapshots
33
33
34
-
Snapshots are not instantaneous; they take time to complete and do not represent perfect point-in-time views of the cluster. While a snapshot is in-progress, you can still index documents and make other requests to the cluster, but new documents (and updates to existing documents) generally aren't included in the snapshot. The snapshot includes primary shards as they existed when Elasticsearch initiated the snapshot. Depending on the size of your snapshot thread pool, different shards might be included in the snapshot at slightly different times.
34
+
Snapshots aren't instantaneous. They take time to complete and do not represent perfect point-in-time views of the cluster. While a snapshot is inprogress, you can still index documents and make other requests to the cluster, but new documents and updates to existing documents generally aren't included in the snapshot. The snapshot includes primary shards as they existed when Elasticsearch initiated the snapshot. Depending on the size of your snapshot thread pool, different shards might be included in the snapshot at slightly different times.
35
35
36
36
Elasticsearch snapshots are incremental, meaning that they only store data that has changed since the last successful snapshot. The difference in disk usage between frequent and infrequent snapshots is often minimal.
37
37
@@ -43,7 +43,7 @@ If you need to delete a snapshot, be sure to use the Elasticsearch API rather th
43
43
44
44
## Register repository
45
45
46
-
Before you can take a snapshot, you have to "register" a snapshot repository. A snapshot repository is really just a storage location: a shared file system, Amazon S3, Hadoop Distributed File System (HDFS), Azure Storage, etc.
46
+
Before you can take a snapshot, you have to "register" a snapshot repository. A snapshot repository is just a storage location: a shared file system, Amazon S3, Hadoop Distributed File System (HDFS), Azure Storage, etc.
47
47
48
48
49
49
### Shared file system
@@ -81,13 +81,13 @@ Before you can take a snapshot, you have to "register" a snapshot repository. A
81
81
}
82
82
```
83
83
84
-
You probably only need to specify `location`, but to summarize the options:
84
+
You probably only need to specify `location`, but the following table summarizes the options:
85
85
86
86
Setting | Description
87
87
:--- | :---
88
88
location | The shared file system for snapshots. Required.
89
89
chunk_size | Breaks large files into chunks during snapshot operations (e.g. `64mb`, `1gb`), which is important for cloud storage providers and far less important for shared file systems. Default is `null` (unlimited). Optional.
90
-
compress | Whether to compress metadata files. This setting does not affect data files, which might already be compressed (depending on your index settings). Default is `false`. Optional.
90
+
compress | Whether to compress metadata files. This setting does not affect data files, which might already be compressed, depending on your index settings. Default is `false`. Optional.
91
91
max_restore_bytes_per_sec | The maximum rate at which snapshots restore. Default is 40 MB per second (`40m`). Optional.
92
92
max_snapshot_bytes_per_sec | The maximum rate at which snapshots take. Default is 40 MB per second (`40m`). Optional.
93
93
readonly | Whether the repository is read-only. Useful when migrating from one cluster (`"readonly": false` when registering) to another cluster (`"readonly": true` when registering). Optional.
@@ -165,7 +165,7 @@ readonly | Whether the repository is read-only. Useful when migrating from one c
165
165
POST _nodes/reload_secure_settings
166
166
```
167
167
168
-
1. Create an S3 bucket if you don't already have one. To take snapshots, you must have permissions to access the bucket. The following IAM policy is an example of those permissions:
168
+
1. Create an S3 bucket if you don't already have one. To take snapshots, you need permissions to access the bucket. The following IAM policy is an example of those permissions:
169
169
170
170
```json
171
171
{
@@ -196,7 +196,7 @@ readonly | Whether the repository is read-only. Useful when migrating from one c
196
196
}
197
197
```
198
198
199
-
You probably don't need to specify anything but `bucket` and `base_path`, but to summarize the options:
199
+
You probably don't need to specify anything but `bucket` and `base_path`, but the following table summarizes the options:
200
200
201
201
Setting | Description
202
202
:--- | :---
@@ -206,7 +206,7 @@ buffer_size | The threshold beyond which chunks (of `chunk_size`) should be brok
206
206
canned_acl | S3 has several [canned ACLs](https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl) that the `repository-s3` plugin can add to objects as it creates them in S3. Default is `private`. Optional.
207
207
chunk_size | Breaks files into chunks during snapshot operations (e.g. `64mb`, `1gb`), which is important for cloud storage providers and far less important for shared file systems. Default is `1gb`. Optional.
208
208
client | When specifying client settings (e.g. `s3.client.default.access_key`), you can use a string other than `default` (e.g. `s3.client.backup-role.access_key`). If you used an alternate name, change this value to match. Default and recommended value is `default`. Optional.
209
-
compress | Whether to compress metadata files. This setting does not affect data files, which depending on your index settings, might already be compressed. Default is `false`. Optional.
209
+
compress | Whether to compress metadata files. This setting does not affect data files, which might already be compressed, depending on your index settings. Default is `false`. Optional.
210
210
max_restore_bytes_per_sec | The maximum rate at which snapshots restore. Default is 40 MB per second (`40m`). Optional.
211
211
max_snapshot_bytes_per_sec | The maximum rate at which snapshots take. Default is 40 MB per second (`40m`). Optional.
212
212
readonly | Whether the repository is read-only. Useful when migrating from one cluster (`"readonly": false` when registering) to another cluster (`"readonly": true` when registering). Optional.
@@ -227,7 +227,7 @@ The following snapshot includes all indices and the cluster state:
227
227
PUT _snapshot/my-repository/1
228
228
```
229
229
230
-
You can also add a request body to include or exclude certain indices or specify some other settings:
230
+
You can also add a request body to include or exclude certain indices or specify other settings:
231
231
232
232
```json
233
233
PUT _snapshot/my-repository/2
@@ -241,12 +241,12 @@ PUT _snapshot/my-repository/2
241
241
242
242
Setting | Description
243
243
:--- | :---
244
-
indices | The indices that you want to include in the snapshot. You can use `,` to create a list of indices, `*` to specify an index pattern, and `-` to exclude certain indices. Don't put spaces between items. Default is all indices.
244
+
indices | The indices you want to include in the snapshot. You can use `,` to create a list of indices, `*` to specify an index pattern, and `-` to exclude certain indices. Don't put spaces between items. Default is all indices.
245
245
ignore_unavailable | If an index from the `indices` list doesn't exist, whether to ignore it rather than fail the snapshot. Default is false.
246
246
include_global_state | Whether to include cluster state in the snapshot. Default is true.
247
247
partial | Whether to allow partial snapshots. Default is false, which fails the entire snapshot if one or more shards fails to store.
248
248
249
-
If you request the snapshot immediately after taking it, you might see something like:
249
+
If you request the snapshot immediately after taking it, you might see something like this:
250
250
251
251
```json
252
252
GET _snapshot/my-repository/2
@@ -267,7 +267,7 @@ GET _snapshot/my-repository/2
267
267
}
268
268
```
269
269
270
-
Note that the snapshot is still in progress. If you want to wait for the snapshot to finish before continuing, add the `wait_for_completion` parameter to your request. Snapshots can take a while to complete, though, so consider whether or not this option fits your use case:
270
+
Note that the snapshot is still in progress. If you want to wait for the snapshot to finish before continuing, add the `wait_for_completion` parameter to your request. Snapshots can take a while to complete, so consider whether or not this option fits your use case:
271
271
272
272
```
273
273
PUT _snapshot/my-repository/3?wait_for_completion=true
@@ -283,7 +283,7 @@ PARTIAL | At least one shard failed to store successfully. Can only occur if you
283
283
FAILED | The snapshot encountered an error and stored no data.
284
284
INCOMPATIBLE | The snapshot is incompatible with the version of Elasticsearch running on this cluster. See [Conflicts and compatibility](#conflicts-and-compatibility).
285
285
286
-
You can't take a snapshot if one is currently in progress. To check:
286
+
You can't take a snapshot if one is currently in progress. To check the status:
287
287
288
288
```
289
289
GET _snapshot/_status
@@ -304,7 +304,7 @@ To see all snapshots in a repository:
304
304
GET _snapshot/my-repository/_all
305
305
```
306
306
307
-
Then you can restore a snapshot:
307
+
Then restore a snapshot:
308
308
309
309
```
310
310
POST _snapshot/my-repository/2/_restore
@@ -333,7 +333,7 @@ POST _snapshot/my-repository/2/_restore
333
333
334
334
Setting | Description
335
335
:--- | :---
336
-
indices | The indices that you want to restore. You can use `,` to create a list of indices, `*` to specify an index pattern, and `-` to exclude certain indices. Don't put spaces between items. Default is all indices.
336
+
indices | The indices you want to restore. You can use `,` to create a list of indices, `*` to specify an index pattern, and `-` to exclude certain indices. Don't put spaces between items. Default is all indices.
337
337
ignore_unavailable | If an index from the `indices` list doesn't exist, whether to ignore it rather than fail the restore operation. Default is false.
338
338
include_global_state | Whether to restore the cluster state. Default is false.
339
339
include_aliases | Whether to restore aliases alongside their associated indices. Default is true.
@@ -356,19 +356,19 @@ We recommend ceasing write requests to a cluster before restoring from a snapsho
356
356
1. A write request to the now-deleted alias creates a new index with the same name as the alias.
357
357
1. The alias from the snapshot fails to restore due to a naming conflict with the new index.
358
358
359
-
Snapshots are only forward-compatible, and only by one major version. For example, snapshots taken on a 2.x cluster can't be restored on a 1.x cluster or a 6.x cluster, but they*can*be restored on a 2.x or 5.x cluster.
359
+
Snapshots are only forward-compatibleby one major version. For example, you can't restore snapshots taken on a 2.x cluster to a 1.x cluster or a 6.x cluster, but you*can*restore them on a 2.x or 5.x cluster.
360
360
361
361
If you have an old snapshot, you can sometimes restore it into an intermediate cluster, reindex all indices, take a new snapshot, and repeat until you arrive at your desired version, but you might find it easier to just manually index your data on the new cluster.
362
362
363
363
364
364
## Security plugin considerations
365
365
366
-
If you are using the security plugin, snapshots have some additional restrictions:
366
+
If you're using the security plugin, snapshots have some additional restrictions:
367
367
368
-
-In order to perform snapshot and restore operations, users must have the built-in `manage_snapshots` role.
368
+
-To perform snapshot and restore operations, users must have the built-in `manage_snapshots` role.
369
369
- You can't restore snapshots that contain global state or the `.opendistro_security` index.
370
370
371
-
If a snapshot contains global state, you must exclude it when performing the restore. If your snapshot also contains the `.opendistro_security` index, either exclude it or list all the other indices that you want to include:
371
+
If a snapshot contains global state, you must exclude it when performing the restore. If your snapshot also contains the `.opendistro_security` index, either exclude it or list all the other indices you want to include:
For information about setting replicas, see [Primary and replica shards](../../elasticsearch/#primary-and-replica-shards).
162
+
For information about setting replicas, see [Primary and replica shards](../../../elasticsearch/#primary-and-replica-shards).
163
163
164
164
### close
165
165
@@ -308,7 +308,7 @@ Parameter | Description | Type
308
308
309
309
### snapshot
310
310
311
-
Backup your cluster’s indices and state. For more information about snapshots, see [Take and restore snapshots](../../elasticsearch/snapshot-restore/).
311
+
Backup your cluster’s indices and state. For more information about snapshots, see [Take and restore snapshots](../../../elasticsearch/snapshot-restore/).
312
312
313
313
The `snapshot` operation has the following parameters:
314
314
@@ -435,7 +435,7 @@ Note that this condition does not execute at exactly 5:00 PM; the job still exec
435
435
436
436
A window of an hour, which this example uses, is generally sufficient, but you might increase it to 2--3 hours to avoid missing the window and having to wait a week for the transition to occur. Alternately, you could use a broader expression such as `* * * * SAT,SUN` to have the transition occur at any time during the weekend.
437
437
438
-
For information on writing cron expressions, see [Cron expression reference](../../alerting/cron/).
438
+
For information on writing cron expressions, see [Cron expression reference](../../../alerting/cron/).
Copy file name to clipboardExpand all lines: docs/im/ism/settings.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,7 @@ Setting | Default | Description
32
32
33
33
## Audit history indices
34
34
35
-
If you don't want to disable ISM audit history or shorten the retention period, you can create an [index template](../../elasticsearch/index-templates/) to reduce the shard count of the history indices:
35
+
If you don't want to disable ISM audit history or shorten the retention period, you can create an [index template](../../../elasticsearch/index-templates/) to reduce the shard count of the history indices:
Copy file name to clipboardExpand all lines: docs/install/helm.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,7 +20,7 @@ Resource | Description
20
20
The specification in the default Helm chart supports many standard use cases and setups. You can modify the default chart to configure your desired specifications and set Transport Layer Security (TLS) and role-based access control (RBAC).
21
21
22
22
For information about the default configuration, steps to configure security, and configurable parameters, see the
The instructions here assume you have a Kubernetes cluster with Helm preinstalled. See the [Kubernetes documentation](https://kubernetes.io/docs/setup/) for steps to configure a Kubernetes cluster and the [Helm documentation](https://helm.sh/docs/intro/install/) to install Helm.
0 commit comments