Commit ebe9893
committed
rgw: make incomplete multipart upload part of bucket check efficient
Previously the incomplete multipart portion of bucket check would list
all entries in the _multipart_ namespace across all shards and then
analyze them in memory before taking further action.
Since all index entries for a given multipart upload are all on the
same shard by design, we can work on this asynchronously shard by
shard. Furthermore since all entries for a given multipart upload are
sequential in the bucket index, we can use a small window to analyze
each of the uploads.
This should make the operation quicker and use much less memory in the
worst cases.
Signed-off-by: J. Eric Ivancich <[email protected]>1 parent 7324aeb commit ebe9893
2 files changed
+252
-88
lines changed
0 commit comments