Skip to content

S3 checksum support for validating object integrity #8487

@guymguym

Description

@guymguym

Environment info

  • NooBaa Version: 5.17
  • Platform: any

Actual behavior

  1. See https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html.
  2. We are missing support for checksum headers x-amz-checksum-mode, x-amz-sdk-checksum-algorithm, x-amz-checksum-XXX.
  3. While we do support Content-MD5 and x-amz-content-sha256 (which is used to protect the signature), the new checsum headers were added to become persistent attributes of the object and retrieved on next head/get.

Expected behavior

  1. Should support checksums calculation and persistency PutObject, CopyObject, UploadPart, UploadPartCopy, and then also retrieval on GetObject, HeadObject.
  2. Should support also Trailers when applicable.

Steps to reproduce

  1. For example aws s3 cp --checksum-mode ENABLED --checksum-algorithm CRC32|CRC32C|SHA1|SHA256 ...

Metadata

Metadata

Assignees

No one assigned

    Labels

    S3-CompatibilityS3 Compatibility and Namespace over AWS

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions