Skip to content

Commit 2d82650

Browse files
committed
release: update xllm release version to v0.7.2.
1 parent 90e72ae commit 2d82650

File tree

5 files changed

+32
-15
lines changed

5 files changed

+32
-15
lines changed

README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -120,22 +120,22 @@ Supported models list:
120120
First, download the image we provide:
121121
```bash
122122
# A2 x86
123-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
123+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
124124
# A2 arm
125-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-arm
125+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-arm
126126
# A3 arm
127-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hc-rc2-arm
127+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hc-rc2-arm
128128
# or
129129
# A2 x86
130-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
130+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
131131
# A2 arm
132-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-arm
132+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-arm
133133
# A3 arm
134-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hc-rc2-arm
134+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hc-rc2-arm
135135
```
136136
Then create the corresponding container:
137137
```bash
138-
sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~/.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
138+
sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~/.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
139139
```
140140

141141
Install official repo and submodules:

README_zh.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -115,22 +115,22 @@ xLLM 提供了强大的智能计算能力,通过硬件系统的算力优化与
115115
首先下载我们提供的镜像:
116116
```bash
117117
# A2 x86
118-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
118+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
119119
# A2 arm
120-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-arm
120+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-arm
121121
# A3 arm
122-
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hc-rc2-arm
122+
docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hc-rc2-arm
123123
# 或者
124124
# A2 x86
125-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
125+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
126126
# A2 arm
127-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-arm
127+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-arm
128128
# A3 arm
129-
docker pull xllm/xllm-ai:xllm-0.7.1-dev-hc-rc2-arm
129+
docker pull xllm/xllm-ai:xllm-0.7.2-dev-hc-rc2-arm
130130
```
131131
然后创建对应的容器
132132
```bash
133-
sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~/.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf quay.io/jd_xllm/xllm-ai:xllm-0.7.1-dev-hb-rc2-x86
133+
sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~/.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf quay.io/jd_xllm/xllm-ai:xllm-0.7.2-dev-hb-rc2-x86
134134
```
135135

136136
下载官方仓库与模块依赖:

RELEASE.md

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,20 @@
1+
# Release xllm 0.7.2
2+
3+
## **Major Features and Improvements**
4+
5+
### Feature
6+
7+
- Enhance Qwen3-MoE to support TP settings beyond 4.
8+
- Implement chunked prefill and prefix cache for Qwen3 MoE.
9+
- Support prefix cache for DeepSeek-V3/R1 models.
10+
11+
### Bugfix
12+
13+
- Fix core dump issue triggered by client disconnection.
14+
- Fix the incorrect reading of model args from Qwen3-VL's config.json.
15+
- Setup the tokenizer config function of bos and eos to fast tokenizer.
16+
- Fix the memory leak issue in the completions interface.
17+
118
# Release xllm 0.7.1
219

320
## **Major Features and Improvements**

version.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
0.7.1
1+
0.7.2

0 commit comments

Comments
 (0)