I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR enhances Hilbert clustering in Databend by introducing block streaming write support and a new data exchange method: modulo-based Flight Scatter. Hilbert clustering now uses the expression

(range_id * node_num) / partition_num

to compute the scatter key, ensuring that adjacent data ranges are co-located on the same node and thus preserving their continuity.

• Block Streaming Write Support: Enables writing data blocks in a streaming fashion during reclustering, improving efficiency and reducing memory usage.
• Modulo-Based Data Exchange: Introduces a data exchange strategy that uses a modulo operation on a specified expression to distribute data across nodes.

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

This change is