File tree Expand file tree Collapse file tree 5 files changed +32
-15
lines changed
Expand file tree Collapse file tree 5 files changed +32
-15
lines changed Original file line number Diff line number Diff line change @@ -120,22 +120,22 @@ Supported models list:
120120First, download the image we provide:
121121``` bash
122122# A2 x86
123- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
123+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
124124# A2 arm
125- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-arm
125+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-arm
126126# A3 arm
127- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hc-rc2-arm
127+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hc-rc2-arm
128128# or
129129# A2 x86
130- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
130+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
131131# A2 arm
132- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-arm
132+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-arm
133133# A3 arm
134- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hc-rc2-arm
134+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hc-rc2-arm
135135```
136136Then create the corresponding container:
137137``` bash
138- sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~ /.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
138+ sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~ /.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
139139```
140140
141141Install official repo and submodules:
Original file line number Diff line number Diff line change @@ -115,22 +115,22 @@ xLLM 提供了强大的智能计算能力,通过硬件系统的算力优化与
115115首先下载我们提供的镜像:
116116``` bash
117117# A2 x86
118- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
118+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
119119# A2 arm
120- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-arm
120+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-arm
121121# A3 arm
122- docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hc-rc2-arm
122+ docker pull quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hc-rc2-arm
123123# 或者
124124# A2 x86
125- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
125+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
126126# A2 arm
127- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-arm
127+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-arm
128128# A3 arm
129- docker pull xllm/xllm-ai:xllm-0.7.1 -dev-hc-rc2-arm
129+ docker pull xllm/xllm-ai:xllm-0.7.2 -dev-hc-rc2-arm
130130```
131131然后创建对应的容器
132132``` bash
133- sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~ /.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf quay.io/jd_xllm/xllm-ai:xllm-0.7.1 -dev-hb-rc2-x86
133+ sudo docker run -it --ipc=host -u 0 --privileged --name mydocker --network=host --device=/dev/davinci0 --device=/dev/davinci_manager --device=/dev/devmm_svm --device=/dev/hisi_hdc -v /var/queue_schedule:/var/queue_schedule -v /usr/local/Ascend/driver:/usr/local/Ascend/driver -v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi -v /usr/local/sbin/:/usr/local/sbin/ -v /var/log/npu/conf/slog/slog.conf:/var/log/npu/conf/slog/slog.conf -v /var/log/npu/slog/:/var/log/npu/slog -v /export/home:/export/home -w /export/home -v ~ /.ssh:/root/.ssh -v /var/log/npu/profiling/:/var/log/npu/profiling -v /var/log/npu/dump/:/var/log/npu/dump -v /home/:/home/ -v /runtime/:/runtime/ -v /etc/hccn.conf:/etc/hccn.conf quay.io/jd_xllm/xllm-ai:xllm-0.7.2 -dev-hb-rc2-x86
134134```
135135
136136下载官方仓库与模块依赖:
Original file line number Diff line number Diff line change 1+ # Release xllm 0.7.2
2+
3+ ## ** Major Features and Improvements**
4+
5+ ### Feature
6+
7+ - Enhance Qwen3-MoE to support TP settings beyond 4.
8+ - Implement chunked prefill and prefix cache for Qwen3 MoE.
9+ - Support prefix cache for DeepSeek-V3/R1 models.
10+
11+ ### Bugfix
12+
13+ - Fix core dump issue triggered by client disconnection.
14+ - Fix the incorrect reading of model args from Qwen3-VL's config.json.
15+ - Setup the tokenizer config function of bos and eos to fast tokenizer.
16+ - Fix the memory leak issue in the completions interface.
17+
118# Release xllm 0.7.1
219
320## ** Major Features and Improvements**
File renamed without changes.
Original file line number Diff line number Diff line change 1- 0.7.1
1+ 0.7.2
You can’t perform that action at this time.
0 commit comments