How to rename buckets in AWS and Azure playbook update (#5)

Signed-off-by: Friedrich Gonzalez <[email protected]>

Author: friedrich-at-adobe

CHANGELOG.md

@@ -3,6 +3,7 @@
 ## master / unreleased
 
 * [CHANGE] Updated readme to use this repo with tanka
+* [ENHANCEMENT] How to rename buckets in AWS and Azure for `not healthy index found` playbook. #5
 
 ## 1.11.0 / 2021-12-30
 

cortex-mixin/docs/playbooks.md

@@ -3,7 +3,7 @@
 This document contains playbooks, or at least a checklist of what to look for, for alerts in the cortex-mixin and logs from Cortex. This document assumes that you are running a Cortex cluster:
 
 1. Using this mixin config
-2. Using GCS as object store (but similar procedures apply to other backends)
+2. Using GCS (Google), S3 (AWS) or Blobs (Azure). Similar procedures apply to other backends.
 
 ## Alerts
 
@@ -413,6 +413,32 @@ Where:
 - `TENANT` is the tenant id reported in the example error message above as `REDACTED-TENANT`
 - `BLOCK` is the last part of the file path reported as `REDACTED-BLOCK` in the example error message above
 
+To rename a block stored on S3 you can use the `aws` CLI command:
+```
+aws s3 mv gs://BUCKET/TENANT/BLOCK gs://BUCKET/TENANT/corrupted-BLOCK
+```
+Where:
+- `BUCKET` is the s3 bucket name the compactor is using.
+- `TENANT` is the tenant id reported in the example error message above as `REDACTED-TENANT`
+- `BLOCK` is the last part of the file path reported as `REDACTED-BLOCK` in the example error message above
+
+
+To rename a block stored on Azure you can use the `azcopy` and `az` CLI command:
+```
+azcopy copy "https://$STORAGE-ACCOUNT.blob.core.windows.net/$CONTAINER/$TENANT/$BLOCK?$SASTOKEN" "https://$STORAGE-ACCOUNT.blob.core.windows.net/$CONTAINER/$TENANT/corrupted-$BLOCK?$SASTOKEN" --recursive
+azcopy remove "https://$STORAGE-ACCOUNT.blob.core.windows.net/$CONTAINER/$TENANT/$BLOCK?$SASTOKEN" --recursive
+```
+Where:
+- `STORAGE-ACCOUNT` is the storage account the compactor is using.
+- `CONTAINER` is what is specified as `-blocks-storage.azure.container-name`
+- `TENANT` is the tenant id reported in the example error message above as REDACTED-TENANT
+- `BLOCK` is the last part of the file path reported as REDACTED-BLOCK in the example error message above
+- `SAS-TOKEN` this is a token that can be created with the following command:
+
+```
+az storage container generate-sas --account-name $STORAGE-ACCOUNT --expiry $(date -v +1d +%Y-%m-%d) --name $CONTAINER --permissions dlrw
+```
+
 ### CortexBucketIndexNotUpdated
 
 This alert fires when the bucket index, for a given tenant, is not updated since a long time. The bucket index is expected to be periodically updated by the compactor and is used by queriers and store-gateways to get an almost-updated view over the bucket store.