You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
From the vllm serve docs I'd expect that it's possible to set servingEngineSpec.vllmApiKey to a comma separated list of API keys. This would allow us to distribute multiple tokens to various stakeholder groups.
Additional context
The current behavior is that while comma separated strings do work but any tokens after the first one are discarded.