v0.1.6

github-actions released this 08 Sep 07:08

· 9883 commits to main since this release

1117aa1

Note: This is an emergency release to revert a breaking API change that can make many existing codes using AsyncLLMServer not work.

What's Changed

faster startup of vLLM by @ri938 in #982
Start background task in AsyncLLMEngine.generate by @Yard1 in #988
Bump up the version to v0.1.6 by @zhuohan123 in #989

New Contributors

@ri938 made their first contribution in #982

Full Changelog: v0.1.5...v0.1.6

Contributors

ri938, Yard1, and zhuohan123

Assets 6