validator_operator/validator_backups

[giscus[bot]]

validator_operator/validator_backups

https://docs.dev.sync.global/validator_operator/validator_backups.html

[elingersin1]

Not sure about the python script to get the token as it seems pretty empty.. This generated correct token for me:
curl --request POST
--url AUTH_URL/oauth/token
--header 'content-type: application/json'
--data '{
"client_id": VALIDATOR_AUTH_CLIENT_ID,
"client_secret": VALIDATOR_AUTH_CLIENT_SECRET,
"audience": VALIDATOR_AUTH_AUDIENCE,
"grant_type": "client_credentials"
}'

[isegall-da]

Note that the python script is for a token for an unauthenticated validator ("If you are running the docker-compose deployment with no auth, you can use the utility Python script get-token.py to generate a token...")

[gyorgy-balazsi-da]

RE: "Note that there is a strict order requirement between the backups: the backup of the validator app’s postgres instance must be taken at a point in time strictly earlier than that of the participant. Please make sure the app’s instance backup is completed before starting the participant one."

Does "at a point in time strictly earlier" mean that in a cloud setup, a volume snapshot that contains both the validator and the participant Postgres instances will not work? The volume snapshot is taken simultaneously, which is not "strictly earlier". (I would be surprised if the volume snapshot didn't work, maybe I'm missing something.)

[stas-sbi]

It'll always work if it's the same postgres instance (where all DBs share the same WAL) and not 100% guaranteed otherwise.

[derrix060]

In order to take a backup for the postgres, I highly suggest using pg_dumpall so you don't need to worry about which database to select, it will get them all:

docker exec -i compose-postgres-splice-1 pg_dumpall -U cnadmin | gzip > "${backup_dir}"/backup-"$(date -u +"%Y-%m-%dT%H:%M:%S%:z")".sql.gz

[nycnewman]

I believe you need to be careful with this approach as there are edgecases where a particular component may not have written to the database at time of pg_dumpall snapshot. The validator DB needs to be earlier than the participant (and subsequent app DB stores earlier than both)