I did benchmarks

[safinaskar]

So here is my own simplistic parallel rdedup alternative, written in Rust, which uses fixed sized chunking (which is great for VM images): borgbackup/borg#7674 (comment) . You can also see there benchmark, which compares my tool to rdedup and other alternatives. And my tool is way faster than all of them. (But I cheat by using fixed sized chunking). See whole issue for context and especially this comment borgbackup/borg#7674 (comment) for comparison between rdedup and other CDC-based tools.

For my tool I implemented my own rayon-based parallel map ( rayon-rs/rayon#1071 )

[safinaskar]

Okay, so here is list of Github issues I spammed wrote in last few days on this topic (i. e. fast fixed-sized and CDC-based deduplication). I hope they provide great insight to everyone interested in fast deduplicated storage.
borgbackup/borg#7674
systemd/casync#259
folbricht/desync#243
ipfs/specs#227
#222
opencontainers/umoci#256