Handling the progress bar for VLLM #26626
JamshidJDMY
announced in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Checked
Feature request
When I am using VLLM using langchain, it shows a progress bar for each input. I read the code of VLLM and Langchain (link) on GitHub and I understood that in line 133, there is parameter called use_tqdm that should be False to disable it but there is no option to disable it using Langchain. Add a new parameters to handle it.
Motivation
My motivation is that enable/disable of progress bar should be optional because it affect on the appearance of applications.
Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions