Skip to content

Commit 6bf59d9

Browse files
authored
Enhance the BulkWriteProcessor (#63)
1. Remove DataCarrier. 2. Make the bulk process in sync mode. Once the bulk size is reached, flush(gRPC) process starts immediately. 3. Add a timer as additional processor when the data slightly overs the bulk size. 4. Expose the gRPC timeout for bulk processor creation. Fix previous misused flushInterval as timeout. 5. Correct concurrency implementation. This OAP concept means, the max accepted sources to flush data concurrently. But the threads are controlled by the OAP persistent timer thread pool.
1 parent 073aa07 commit 6bf59d9

29 files changed

+127
-1537
lines changed

src/main/java/org/apache/skywalking/banyandb/commons/datacarrier/DataCarrier.java

Lines changed: 0 additions & 166 deletions
This file was deleted.

src/main/java/org/apache/skywalking/banyandb/commons/datacarrier/EnvUtil.java

Lines changed: 0 additions & 50 deletions
This file was deleted.

src/main/java/org/apache/skywalking/banyandb/commons/datacarrier/buffer/ArrayBlockingQueueBuffer.java

Lines changed: 0 additions & 67 deletions
This file was deleted.

src/main/java/org/apache/skywalking/banyandb/commons/datacarrier/buffer/Buffer.java

Lines changed: 0 additions & 76 deletions
This file was deleted.

src/main/java/org/apache/skywalking/banyandb/commons/datacarrier/buffer/BufferStrategy.java

Lines changed: 0 additions & 23 deletions
This file was deleted.

0 commit comments

Comments
 (0)