s3Object.Body.transformToWebStream().pipeTo(Writable.toWeb(destinationStream)) promise never settle from 3.729.0

[ert78gb]

Checkboxes for prior research

• I've gone through Developer Guide and API reference
• I've checked AWS Forums and StackOverflow.
• I've searched for previous similar issues and didn't find any solution.

Describe the bug

await s3Object.Body.transformToWebStream().pipeTo(Writable.toWeb(destinationStream)) never settle from @aws-sdk/client-s3@3.729.0.
Everything works fine with @aws-sdk/client-s3@3.726.1

The issue is present in the latest 3.731.1 version too.

Regression Issue

• Select this option if this issue appears to be a regression.

SDK version number

@aws-sdk/client-s3@3.729.0, @aws-sdk/client-s3@3.731.1

Which JavaScript Runtime is this issue in?

Node.js

Details of the browser/Node.js/ReactNative version

v22.13.0, v23.6.0

Reproduction Steps

Reproduction repo https://github.com/ert78gb/aws-sdk3-729-0-s3-streampipe-issue

Observed Behavior

The stream pipe crashes

Expected Behavior

no crash

Possible Solution

If you don't use stream, but consume much memory in case of large files.

Additional Information/Context

Maybe the related Node.js issue nodejs/node#56139
BUT everything works fine with node 22 and 23 with @aws-sdk/client-s3@3.726.1
so an aws sdk modification breaks this.

[agustin-golmar]

Exactly the same problem, but in another context:

It stops between steps C and D forever:

This methods works perfectly for years, but brokes after update NPM dependency @aws-sdk/client-s3 to 3.731.1.

The Node.js runtime version is 20.18.0. I think that the method that cause the halt was:

const manifest = await (integrityManifest.Body?.transformToString("utf-8"))

but I was wrong, it was the previously getObjectAsync that was called just before this.

Good luck!

[s1owjke]

We encountered a similar issue during the upgrade of @aws-sdk/client-s3 from 3.717.0 to 3.731.1.

The problem only occurs for files with checksum (which is now calculated by default since 3.729.0 release). This issue only affects the transformToWebStream method, which appears to never close properly, which is a root cause.

[gsf4726]

We just encountered this bug as well after upgrading @aws-sdk/client-s3 from 3.726.1 that is blocking our S3 downloads.

I'm surprised there's not more activity around this or investigation started?

Here's our usage that demonstrates the issue:

const downloadFileStream = fs.createWriteStream(filePath);
const response = await this.client.send(new GetObjectCommand(input));
await pipeline(response.Body.transformToWebStream(), writableStream); // <-- Never resolves

[kuhe]

Hi, thanks to everyone who reported this issue.

This should be fixed as of https://github.com/aws/aws-sdk-js-v3/releases/tag/v3.735.0 with
https://www.npmjs.com/package/@aws-sdk/client-s3/v/3.735.0.