Use case

In our case, we will have many stateless writer nodes:

• Fetch logs from Kafka firstly
• Buffering logs in such nodes for some seconds
• Finally flush the logs into remote Clickhouse

The problem I encounter is:

• I want to call take_and_prepare_chunk to compress the logs data frequently to save memory
  (log data is usually large, and such simple writer node usually only have small memory).

• However, I need to limit the actual send call, we can't write the remote Clickhouse too aggressively—we need to keep it healthy.

So I think, maybe expose such a api will be useful

Describe the solution you'd like

It is just a small change, I can help it.

Describe the alternatives you've considered

Additional context