Release v0.2.18

Ying1123 released this 05 Jul 11:13

· 522 commits to main since this release

d578599

Release MT-bench code and data
- Demo, Leaderboard, Human annotation data
Release new models
- Vicuna-33B v1.3 and LongChat
Support more models (Falcon, Salesforce/xgen, Salesforce/codet5p-6b, Robin-7B/13B/33B, Baichuan-7B)
Integrate vLLM worker for continuous batching and high-throughput serving. See doc.

Assets 2