Can I clone snapshot data to my bucket through S3

[J1a-wei]

Hi, I has deployed lotus in my eks. To reduce costs, I want to copy snapshot into my s3 .

I'm not sure this scenario is feasible.It looks like the URL is the redirection to the latest Snapshot

$ curl -i https://fil-chain-snapshots-fallback.s3.amazonaws.com/mainnet/minimal_finality_stateroots_latest.car
HTTP/1.1 200 OK
x-amz-id-2: S3Fr+I0GFmY1X3JgEn+kshev1h6XmlqLqaBq5JEvvwFqrDh9wbBlP82kdIxgdAMjbyOVm4L55ck=
x-amz-request-id: XJJF8KK505CRJ49C
Date: Wed, 08 Jun 2022 08:51:03 GMT
Last-Modified: Wed, 08 Jun 2022 08:04:28 GMT
ETag: "fab82f5ac6df8f774494e9bee582ee8f-9177"
x-amz-website-redirect-location: https://fil-chain-snapshots-fallback.s3.amazonaws.com/mainnet/minimal_finality_stateroots_1878720_2022-06-08_06-00-00.car
Accept-Ranges: bytes
Content-Type: binary/octet-stream
Server: AmazonS3
Content-Length: 76981008243

It is impossible to judge where the Filecoin Snapshot S3 region is through the URL. I am not sure if I will encounter problems such as permissions. Can you give me some tips?

[LexLuthr]

@skrbug AWS does not allow hardware to connect across zones but that is the URL to an object. It doesn't require permission.
You can simply use the documented steps to download the snapshot.

[J1a-wei]

By the way. I don't clone all the data, I only clone the latest data of the day, and clean the old data regularly

[J1a-wei]

We are making a product for developers. The point is that I can't find where the bucket which provide snapshot content

[LexLuthr]

@travisperson Can you help with this ask? They want to copy out snapshot from bucket as soon as it is available.

[travisperson]

Not with the fil-chain-snapshots-fallback bucket. There is no support for that bucket. We are working on a new service to provide snapshots through s3. Once that is launched this issue can be reopened and I can possibly assists.

[J1a-wei]

Thank you for your answers @travisperson @LexLuthr

We are looking forward to this feature!

[LexLuthr]

@skrbug I am archiving this discussion for now. Once we have new service in place, we can open a new discussion for technicals to copy the objects from that bucket.