Adapt to open source inference framework #11
Description
Have you considered incorporating this work into an open source inference framework, such as vLLM?
{{ message }}
Have you considered incorporating this work into an open source inference framework, such as vLLM?