Skip to content

Commit 5703d7a

Browse files
authored
update installation readme (#3429)
1 parent 615930b commit 5703d7a

File tree

4 files changed

+58
-26
lines changed

4 files changed

+58
-26
lines changed

docs/get_started/installation/Enflame_gcu.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -53,21 +53,24 @@ After driver installation, **re-enter the Docker container**:
5353
docker start paddle-gcu-llm
5454
docker exec -it paddle-gcu-llm bash
5555
```
56-
5. Install PaddlePaddle
56+
5. Install PaddlePaddle & PaddleCustomDevice<br/>
5757
```bash
5858
# PaddlePaddle Deep Learning Framework provides fundamental computing capabilities
59-
python -m pip install paddlepaddle==3.1.0a0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
60-
```
61-
6. Install PaddleCustomDevice<br/>
62-
```bash
59+
python -m pip install paddlepaddle==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
60+
6361
# PaddleCustomDevice implements custom hardware backend for PaddlePaddle, providing GCU operator implementations
64-
python -m pip install paddle-custom-gcu==3.1.0 -i https://www.paddlepaddle.org.cn/packages/stable/gcu/
62+
python -m pip install paddle-custom-gcu==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/gcu/
6563
# For source compilation, refer to: https://github.com/PaddlePaddle/PaddleCustomDevice/blob/develop/backends/gcu/README_cn.md
6664
```
67-
7. Install FastDeploy and dependencies
65+
For latest paddle verion on iluvatar. Refer to [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/)
66+
67+
6. Install FastDeploy and dependencies
6868
```bash
6969
python -m pip install fastdeploy -i https://www.paddlepaddle.org.cn/packages/stable/gcu/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels
70-
# For source compilation, refer to the following steps
70+
```
71+
72+
You can build FastDeploy from source if you need the ```latest version```.
73+
```bash
7174
git clone https://github.com/PaddlePaddle/FastDeploy
7275
cd FastDeploy
7376
python -m pip install -r requirements.txt --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels

docs/get_started/installation/iluvatar_gpu.md

Lines changed: 17 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-ixuca:latest
1818
```
1919

2020
## Container Preparation
21-
1. Start Container
21+
### Start Container
2222

2323
```bash
2424
docker run -itd --name paddle_infer -v /usr/src:/usr/src -v /lib/modules:/lib/modules -v /dev:/dev -v /home/paddle:/home/paddle --privileged --cap-add=ALL --pid=host ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-ixuca:latest
@@ -27,13 +27,26 @@ docker exec -it paddle_infer bash
2727

2828
/home/paddle contains the model files, *.whl packages, and scripts.
2929

30-
1. Install packages
30+
### Install paddle
3131

3232
```bash
33-
pip3 install paddlepaddle==3.1.0a0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
34-
pip3 install paddle-iluvatar-gpu==3.1.0 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/
33+
pip3 install paddlepaddle==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
34+
pip3 install paddle-iluvatar-gpu==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/
35+
```
36+
For latest paddle verion on iluvatar. Refer to [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/)
37+
38+
### Install or build FastDeploy
39+
```bash
3540
pip3 install fastdeploy_iluvatar_gpu==2.1.0.dev0 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels
3641
```
42+
You can build FastDeploy from source if you need the ```latest version```.
43+
```bash
44+
git clone https://github.com/PaddlePaddle/FastDeploy
45+
cd FastDeploy
46+
pip install -r requirements_iluvatar.txt
47+
export LD_PRELOAD=/usr/local/corex/lib64/libcuda.so.1
48+
bash build.sh
49+
```
3750

3851
## Prepare the inference demo script
3952

docs/zh/get_started/installation/Enflame_gcu.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -52,21 +52,24 @@ bash TopsRider_i3x_*_deb_amd64.run --driver --no-auto-load -y
5252
docker start paddle-gcu-llm
5353
docker exec -it paddle-gcu-llm bash
5454
```
55-
5. 安装 PaddlePaddle<br/>
55+
5. 安装 PaddlePaddle & PaddleCustomDevice<br/>
5656
```bash
5757
# PaddlePaddle『飞桨』深度学习框架,提供运算基础能力
58-
python -m pip install paddlepaddle==3.1.0a0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
59-
```
60-
6. 安装 PaddleCustomDevice<br/>
61-
```bash
58+
python -m pip install paddlepaddle==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
59+
6260
# PaddleCustomDevice是PaddlePaddle『飞桨』深度学习框架的自定义硬件接入实现,提供GCU的算子实现
63-
python -m pip install paddle-custom-gcu==3.1.0 -i https://www.paddlepaddle.org.cn/packages/stable/gcu/
61+
python -m pip install paddle-custom-gcu==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/gcu/
6462
# 如想源码编译安装,请参考https://github.com/PaddlePaddle/PaddleCustomDevice/blob/develop/backends/gcu/README_cn.md
6563
```
66-
7. 安装 FastDeploy <br/>
64+
获取Paddle的最新安装版本: [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/)
65+
66+
6. 安装 FastDeploy <br/>
6767
```bash
6868
python -m pip install fastdeploy -i https://www.paddlepaddle.org.cn/packages/stable/gcu/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels
69-
# 如想源码编译安装,请参考如下步骤
69+
```
70+
71+
可以按如下步骤编译FastDeploy,得到```最新版本```.
72+
```bash
7073
git clone https://github.com/PaddlePaddle/FastDeploy
7174
cd FastDeploy
7275
python -m pip install -r requirements.txt --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels

docs/zh/get_started/installation/iluvatar_gpu.md

Lines changed: 19 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# 如何在天数机器上运行 ERNIE-4.5-300B-A47B-BF16 & ERNIE-4.5-21B-A3B
2-
当前版本软件只是作为天数芯片 + Fastdeploy 推理大模型的一个演示 demo,跑最新ERNIE4.5模型可能存在问题,后续进行修复和性能优化,给客户提供一个更稳定的版本
2+
该软件的当前版本仅作为Iluvatar CoreX与大型模型的Fastdeploy推理框架相结合的演示。在GSM8K数据集上运行最新的ERNIE4.5 300B模型大约需要6.3小时
33

44
## 准备机器
55
首先您需要准备以下配置的机器
@@ -18,7 +18,7 @@ docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-ixuca:latest
1818
```
1919

2020
## 准备容器
21-
1. 启动容器
21+
### 启动容器
2222

2323
```bash
2424
docker run -itd --name paddle_infer -v /usr/src:/usr/src -v /lib/modules:/lib/modules -v /dev:/dev -v /home/paddle:/home/paddle --privileged --cap-add=ALL --pid=host ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-ixuca:latest
@@ -27,12 +27,25 @@ docker exec -it paddle_infer bash
2727

2828
/home/paddle 为模型文件、whl包、脚本所在目录
2929

30-
1. 安装whl包
30+
### 安装paddle
3131

3232
```bash
33-
pip3 install paddlepaddle==3.1.0a0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
34-
pip3 install paddle-iluvatar-gpu==3.1.0 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/
35-
pip3 install fastdeploy_iluvatar_gpu -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels
33+
pip3 install paddlepaddle==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
34+
pip3 install paddle-iluvatar-gpu==3.1.1 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/
35+
```
36+
获取Paddle的最新安装版本: [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/)
37+
38+
### 安装fastdeploy
39+
```bash
40+
pip3 install fastdeploy_iluvatar_gpu==2.1.0.dev0 -i https://www.paddlepaddle.org.cn/packages/stable/ixuca/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simplels
41+
```
42+
可以按如下步骤编译FastDeploy,,得到```最新版本```.
43+
```bash
44+
git clone https://github.com/PaddlePaddle/FastDeploy
45+
cd FastDeploy
46+
pip install -r requirements_iluvatar.txt
47+
export LD_PRELOAD=/usr/local/corex/lib64/libcuda.so.1
48+
bash build.sh
3649
```
3750

3851
## 准备推理demo脚本

0 commit comments

Comments
 (0)