Revisit Ozone hsync implementation #5641
jojochuang
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, I've playing with a few ideas to improve Ozone hsync performance. Been prototyping and benchmarking the ideas the past few months.
There are several improvement ideas that can make Ozone latency/throughput close to that of HDFS. Sharing the thoughts here feel free to check out.
https://docs.google.com/document/d/1ObTiJzDdcd9_ZN6x2fDKh0D5yBLlQp2jBwYrxGOgtRo/edit?usp=sharing
One idea that requires a big change is redesigning PutBlock chunk list. Let client send incremental, partial chunks in PutBlock.
https://docs.google.com/document/d/1Q7skR1xndQ1W3qzkz5rdwjN_2ZFA1zD63bZtKHciY28/edit?usp=sharing
I will attach more design docs for other improvement ideas for review later.
Beta Was this translation helpful? Give feedback.
All reactions