How to Download Multiple Files from S3 Simultaneously Using Go SDK?

[Kashyap25]

I'm working with the AWS SDK for Go and I have a use case where I need to download multiple files from an S3 bucket at once.

Instead of downloading files one-by-one using individual GetObject requests, I'd like to batch the download of multiple S3 objects — ideally by providing a list of object keys and handling their download concurrently (either in-memory or written to disk).

Example scenario:

I have 100+ S3 object keys.

I want to fetch them all concurrently and process them after download.

It should be scalable and avoid opening all file handles simultaneously.

[Madrigal]

The most similar thing we have today is the S3 Transfer Manager, but its use case is mostly about being able to download all files in a bucket instead of processing a lot of individuals objects.

Can you elaborate on your use case, and what kind of processing would you be interested in doing after downloading them?

[Kashyap25]

I just want to download multiple images from S3, resize them, and show them on the screen at once.

Right now, I have to download each image one by one by giving its URL, and that takes too much time.

Is there any way I can give a list/array of image URLs and download them all at once from S3, instead of making multiple separate calls?

[Madrigal]

OK, so currently the SDK does not have a utility to do this. You can create a feature request in our list of issues and we can gauge how much public interest this feature has.

However, if you have specific needs, like controlling the exact file location output, or want to have more control on the object transformation, it may be easier for you to implement something yourself rather than wait for a solution from us