TextChunker CPU usage #690
xkzhud
started this conversation in
2. Feature requests
Replies: 3 comments
-
|
Could you provide a file to reproduce the problem? |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
sure .here is the doc |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
TODO: work with tokens, chunking/counting only once. To be part of semantic chunker feature. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Context / Scenario
finally,i found the problem. when excuting partition.
What happened?
when excuting partition step , the cpu increae from 0.06% to 46.6%. and the speed is slow. this perfomance problem may make km unusable.
the cpu cost should be reduce and the time cost should be reduce.
Importance
I cannot use Kernel Memory
Platform, Language, Versions
.net8
Relevant log output
No response
Beta Was this translation helpful? Give feedback.
All reactions