Commit 11bd20b
authored
Add Amazon S3's parallel SHA2-256 (#343)
When data is uploaded to S3 in can be chunked. Each chunk is hashed, those hashes
are then concatenated and hashes again into a single hash.
Quilt is using 8MiB chunks, but increases the size in case the input is large, as the
maximum size of chunks is 10k.
For all details about the hash algorithm see:
https://github.com/quiltdata/quilt/blob/fb36269def0f8b811e0c1293fcf3e853732a7b71/docs/sha2-256-chunked.md1 parent d06fc61 commit 11bd20b
1 file changed
+1
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
510 | 510 | | |
511 | 511 | | |
512 | 512 | | |
| 513 | + | |
513 | 514 | | |
514 | 515 | | |
515 | 516 | | |
| |||
0 commit comments