v0.2.1
Pre-release
Pre-release
What's Changed
- fix: max-cpu-loras should be initialized from max-loras by @shmuelk in #77
- Support space separated arguments, use correct format in config file by @irar2 in #78
Full Changelog: v0.2.0...v0.2.1
Migrating from releases prior to v0.2.0
max-running-requestswas replaced bymax-num-seqslorawas replaced bylora-modules, which is now a list of JSON strings, e.g, '{"name": "name", "path": "lora_path", "base_model_name": "id"}'