Vector database cannot set request frequency #2084
peanutsugarlove
started this conversation in
1. Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Using OpenAI compatibility, the API can only receive up to 10 batches at a time, resulting in errors. I would like to add a request batch size setting
As shown in the figure below

Beta Was this translation helpful? Give feedback.
All reactions