v1.3.0 Release

English Version

New Features:

1. Serving supported: LoRA and full-parameter training models are supported in vllm/chatglm.cpp/xinference deployment, check the documentation for details by make docs or docs/source/GetStarted/Deployment.md file.
2. Support training and inference with CLI and inference with Web-UI.

New Adapters:

• QALoRA
• Long-LoRA
• ROME

New Models:

1. xverse-65b
2. yi-6b
3. ziya2-13b
4. ziya2-13b-chat
5. mistral-7b
6. openbuddy-mistral-7b-chat
7. mistral-7b-chat
8. chatglm3-6b-base
9. chatglm3-6b
10. chatglm3-6b-32k

New Quantized Models:

1. qwen-7b-chat-int4
2. qwen-14b-chat-int4
3. qwen-vl-chat-int4
4. baichuan2-7b-chat-int4
5. baichuan2-13b-chat-int4
6. qwen-7b-chat-int8
7. qwen-14b-chat-int8

---

中文版
新功能:

1. 支持部署：全参数训练及LoRA训练支持以vllm/chatglm.cpp/xinference方式进行部署，可以通过make docs生成官方文档或查看docs/source/GetStarted/Deployment.md文件
2. 支持CLI方式运行训练和推理，同时支持以Web-UI方式运行推理

新的Adapters：

• QALoRA
• Long-LoRA
• ROME

支持训练和推理的新模型:

1. xverse-65b
2. yi-6b
3. ziya2-13b
4. ziya2-13b-chat
5. mistral-7b
6. openbuddy-mistral-7b-chat
7. mistral-7b-chat
8. chatglm3-6b-base
9. chatglm3-6b
10. chatglm3-6b-32k

支持训练和推理的新量化模型:

1. qwen-7b-chat-int4
2. qwen-14b-chat-int4
3. qwen-vl-chat-int4
4. baichuan2-7b-chat-int4
5. baichuan2-13b-chat-int4
6. qwen-7b-chat-int8
7. qwen-14b-chat-int8

---

Feature Commits

• add lint script by @tastelikefeet in #94
• add document by @Jintao-Huang in #103
• Update framework.txt by @zzclynn in #105
• Feat/deepspeed by @Jintao-Huang in #39
• update sh by @Jintao-Huang in #106
• Add baichuan2 13b sh by @Jintao-Huang in #108
• Support mistral 7b by @Jintao-Huang in #112
• Support int4 by @Jintao-Huang in #116
• Support qwen int8 by @Jintao-Huang in #117
• support qa_lora by @tastelikefeet in #104
• Add longlora for llama by @tastelikefeet in #115
• Support ROME by @tastelikefeet in #121
• Feat 1018 by @Jintao-Huang in #119
• Add script for ROME by @tastelikefeet in #123
• Update doc by @tastelikefeet in #125
• Feat 1028 by @Jintao-Huang in #122
• update web ui and swift cli by @Jintao-Huang in #126
• ResTuning readme by @jiangzeyinzi in #129
• Update doc by @tastelikefeet in #131

Bug Fix:

• Fix qwen bug by @Jintao-Huang in #98
• fix ci by @tastelikefeet in #109
• fix resume from checkpointing bug by @Jintao-Huang in #110
• fix openbuddy template by @Jintao-Huang in #113
• update ziya2 by @Jintao-Huang in #114
• Fix bug in ROME by @tastelikefeet in #128
• fix rome by @tastelikefeet in #133

New Contributors

• @zzclynn made their first contribution in #105

Full Changelog: v1.2.0...v1.3.0