Revisit Ozone hsync implementation #5641
jojochuang
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, I've playing with a few ideas to improve Ozone hsync performance. Been prototyping and benchmarking the ideas the past few months.
There are several improvement ideas that can make Ozone latency/throughput close to that of HDFS. Sharing the thoughts here feel free to check out.
https://docs.google.com/document/d/1ObTiJzDdcd9_ZN6x2fDKh0D5yBLlQp2jBwYrxGOgtRo/edit?usp=sharing
One idea that requires a big change is redesigning PutBlock chunk list. Let client send incremental, partial chunks in PutBlock.
https://docs.google.com/document/d/1Q7skR1xndQ1W3qzkz5rdwjN_2ZFA1zD63bZtKHciY28/edit?usp=sharing
I will attach more design docs for other improvement ideas for review later.
Beta Was this translation helpful? Give feedback.
All reactions