Skip to content

Commit 8689282

Browse files
committed
Add note on S3 replication
It's not clear from these docs that S3 object replication doesn't work reliably. This commit spells this out and explains why.
1 parent 62ce505 commit 8689282

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

deploy-manage/tools/snapshot-and-restore/s3-repository.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -377,6 +377,13 @@ AWS instances resolve S3 endpoints to a public IP. If the {{es}} instances resid
377377

378378
Instances residing in a public subnet in an AWS VPC will connect to S3 via the VPC’s internet gateway and not be bandwidth limited by the VPC’s NAT instance.
379379

380+
## Replicating objects [repository-s3-replicating-objects]
381+
382+
AWS S3 supports [replication of objects](https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication.html), both within a single region and across regions.
383+
Unfortunately this replication is not compatible with {{es}} snapshots.
384+
The objects that {{es}} writes to the repository refer to other objects which already exist in the repository, and {{es}} only deletes an object from the repository after it becomes unreferenced by all other objects.
385+
AWS S3 replication will apply operations to the replica repository in a different order from the order in which {{es}} applies them to the primary repository, and this may leave the replica repository in an invalid state, with objects referring to other objects that do not exist.
386+
To replicate a repository's contents elsewhere you must follow the [repository backup](snapshot-and-restore/self-managed.md#snapshots-repository-backup) process.
380387

381388
## S3-compatible services [repository-s3-compatible-services]
382389

0 commit comments

Comments
 (0)