`UploadPartCommand` is returning a checksum while I said in `CreateMultipartUploadCommand` I want a `FULL_OBJECT` checksum check

[kasir-barati]

Checkboxes for prior research

• I've gone through Developer Guide and API reference
• I've checked AWS Forums and StackOverflow.
• I've searched for previous similar issues and didn't find any solution.

Describe the bug

So I have a NestJS app, there I am using @aws-sdk/s3-client to upload a file in multiple part. The thing is that UploadPart is generating a checksum for each UploadPartCommand. So can you kindly confirm if this is a bug?

I mean I also suspect that I am doing something wrong, but my console.logs are not saying that

Regression Issue

• Select this option if this issue appears to be a regression.

SDK version number

@aws-sdk/client-s3@3.744.0

Which JavaScript Runtime is this issue in?

Node.js

Details of the browser/Node.js/ReactNative version

v22.12.0

Reproduction Steps

1. Clone the repo
2. cd microservices/grpc.
3. pnpm i --frozen-lockfile.
4. cp apps/file-upload/.env.example apps/file-upload/.env.
5. Change the env variables to the ones you get from the AWS and remove the OBJECT_STORAGE_ENDPOINT. It should be used only for local testing with Minio.
6. nx serve file-upload.
7. nx e2e file-upload-e2e.

Observed Behavior

It says something like the calculated CRC32 does not match the one specified in the CompleteMultipartUploadCommand.

Expected Behavior

Just complete the multipart upload.

Possible Solution

Dunno.

Additional Information/Context

• Here is where you can see the UploadPartCommand is returning a checksum for each part.
• While you can clearly see that I have said please use a FULL_OBJECT checksum check here. BTW feel free to add more console.logs to see if I am setting those configs correctly.
• And here is where I try to complete the file upload.

BTW if you're interested in my test, you can find it here.

[kasir-barati]

BTW here is the simplified version which works: https://github.com/kasir-barati/bugs/blob/aws-s3-multipart-completion-error/simplified.ts

But I am doing the exact same thing in my NestJS app and IDK why it is failing.

[kasir-barati]

My Bad, actually I just realized that this is the intended behavior. So to sum it up, when uploading each part even if you have said that you need a FULL_OBJECT checksum check it will return a checksum for each part.

We need those checksums when sending a complete multipart upload:

import { S3Client, UploadPartCommand } from '@aws-sdk/client-s3';

const parts: CompletedPart[] = [];
const objectKey = 'hey';
const bucketName = 'buck';
const uploadId = 'returned value from CreateMultipartUploadCommand';

const command = new UploadPartCommand({
  Bucket: this.bucketName,
  Key: objectKey,
  UploadId: uploadId,
  PartNumber: chunkPart,
  Body: data,
});
const response = await s3Client.send(command);

parts.push({
  PartNumber: chunkPart,
  ETag: response.ETag,
  ...(response.ChecksumCRC32 && {
    ChecksumCRC32: response.ChecksumCRC32,
  }),
  ...(response.ChecksumCRC32C && {
    ChecksumCRC32C: response.ChecksumCRC32C,
  }),
});

const checksum = 'calculated base64 crc32 checksum';
const command = new CompleteMultipartUploadCommand({
  Bucket: bucketName,
  Key: objectKey,
  UploadId: uploadId,
  ChecksumType: 'FULL_OBJECT',
  ChecksumCRC32: checksum,
  MultipartUpload: { Parts: parts },
});
await s3Client.send(command);

[github-actions]

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.

[github-actions]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs and link to relevant comments in this thread.