Skip to content

Commit e5d6f23

Browse files
authored
Merge pull request #1801 from TeslaZhao/v0.9.0
Merge pull request #1800 from TeslaZhao/develop
2 parents f7a603f + 49aab50 commit e5d6f23

File tree

4 files changed

+130
-35
lines changed

4 files changed

+130
-35
lines changed

doc/Install_CN.md

Lines changed: 53 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
- [1.使用开发镜像](#1)
66
- [Serving 开发镜像](#1.1)
7+
- [CPU 镜像](#1.1.1)
8+
- [GPU 镜像](#1.1.2)
9+
- [ARM & XPU 镜像](#1.1.3)
710
- [Paddle 开发镜像](#1.2)
11+
- [CPU 镜像](#1.2.1)
12+
- [GPU 镜像](#1.2.2)
813
- [2.安装 Wheel 包](#2)
914
- [在线安装](#2.1)
1015
- [离线安装](#2.2)
16+
- [ARM & XPU 包安装](#2.3)
1117
- [3.环境检查](#3)
1218

1319

@@ -33,33 +39,52 @@
3339
| CUDA10.2 + cuDNN 7 | 0.9.0-cuda10.2-cudnn7-devel | Ubuntu 16 | 2.3.0-gpu-cuda10.2-cudnn7 | Ubuntu 18
3440
| CUDA10.2 + cuDNN 8 | 0.9.0-cuda10.2-cudnn8-devel | Ubuntu 16 || Ubuntu 18 |
3541
| CUDA11.2 + cuDNN 8 | 0.9.0-cuda11.2-cudnn8-devel | Ubuntu 16 | 2.3.0-gpu-cuda11.2-cudnn8 | Ubuntu 18 |
42+
| ARM + XPU | xpu-arm | CentOS 8.3 |||
3643

3744
对于**Windows 10 用户**,请参考文档[Windows平台使用Paddle Serving指导](Windows_Tutorial_CN.md)
3845

39-
4046
<a name="1.1"></a>
4147

4248
### 1.1 Serving开发镜像(CPU/GPU 2选1)
49+
50+
<a name="1.1.1"></a>
51+
4352
**CPU:**
4453
```
4554
# 启动 CPU Docker
4655
docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-devel
47-
docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
48-
docker exec -it test bash
56+
docker run -p 9292:9292 --name test_cpu -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
57+
docker exec -it test_cpu bash
4958
git clone https://github.com/PaddlePaddle/Serving
5059
```
60+
61+
<a name="1.1.2"></a>
62+
5163
**GPU:**
5264
```
5365
# 启动 GPU Docker
5466
docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn8-devel
55-
nvidia-docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn8-devel bash
56-
nvidia-docker exec -it test bash
67+
nvidia-docker run -p 9292:9292 --name test_gpu -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn8-devel bash
68+
nvidia-docker exec -it test_gpu bash
69+
git clone https://github.com/PaddlePaddle/Serving
70+
```
71+
72+
<a name="1.1.3"></a>
73+
74+
**ARM & XPU: **
75+
```
76+
docker pull registry.baidubce.com/paddlepaddle/serving:xpu-arm
77+
docker run -p 9292:9292 --name test_arm_xpu -dit registry.baidubce.com/paddlepaddle/serving:xpu-arm bash
78+
docker exec -it test_arm_xpu bash
5779
git clone https://github.com/PaddlePaddle/Serving
5880
```
5981

6082
<a name="1.2"></a>
6183

6284
### 1.2 Paddle开发镜像(CPU/GPU 2选1)
85+
86+
<a name="1.2.1"></a>
87+
6388
**CPU:**
6489
```
6590
### 启动 CPU Docker
@@ -71,6 +96,9 @@ git clone https://github.com/PaddlePaddle/Serving
7196
### Paddle开发镜像需要执行以下脚本增加Serving所需依赖项
7297
bash Serving/tools/paddle_env_install.sh
7398
```
99+
100+
<a name="1.2.2"></a>
101+
74102
**GPU:**
75103
```
76104
### 启动 GPU Docker
@@ -103,6 +131,7 @@ pip3 install -r python/requirements.txt
103131
<a name="2.1"></a>
104132

105133
### 2.1 在线安装
134+
在线安装采用 `pypi` 下载并安装的方式。
106135

107136
```shell
108137
pip3 install paddle-serving-client==0.9.0 -i https://pypi.tuna.tsinghua.edu.cn/simple
@@ -158,6 +187,7 @@ pip3 install https://paddle-inference-lib.bj.bcebos.com/2.3.0/python/Linux/GPU/x
158187
<a name="2.2"></a>
159188

160189
### 2.2 离线安装
190+
离线安装是指所有的 Paddle 和 Serving 包和依赖库,传入到无网或弱网环境下安装。
161191

162192
**1.安装离线 Wheel 包**
163193

@@ -223,6 +253,24 @@ python3 install.py --cuda_version="" --python_version="py39" --device="cpu" --se
223253
python3 install.py --cuda_version="112" --python_version="py36" --device="GPU" --serving_version="no_install" --paddle_version="2.3.0"
224254
```
225255

256+
<a name="2.3"></a>
257+
258+
### 2.3 ARM & XPU 安装 wheel 包
259+
260+
由于使用 ARM 和 XPU 的用户较少,安装此环境的 Wheel 单独提供如下,其中 `paddle_serving_client` 仅提供 `py36` 的版本,如需其他版本请与我们联系。
261+
262+
```
263+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_app-0.9.0-py3-none-any.whl
264+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_client-0.9.0-cp36-none-any.whl
265+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
266+
```
267+
268+
二进制包地址:
269+
```
270+
wget https://paddle-serving.bj.bcebos.com/test-dev/bin/serving-xpu-aarch64-0.9.0.tar.gz
271+
```
272+
273+
226274
<a name="3"></a>
227275

228276
## 3.环境检查

doc/Install_EN.md

Lines changed: 60 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
- [1.Use devel docker](#1)
66
- [Serving devel images](#1.1)
7+
- [CPU images](#1.1.1)
8+
- [GPU images](#1.1.2)
9+
- [ARM & XPU images](#1.1.3)
710
- [Paddle devel images](#1.2)
11+
- [CPU images](#1.2.1)
12+
- [GPU images](#1.2.2)
813
- [2.Install Wheel Packages](#2)
914
- [Online Install](#2.1)
1015
- [Offline Install](#2.2)
16+
- [ARM & XPU Install](#2.3)
1117
- [3.Installation Check](#3)
1218

1319
**Strongly recommend** you build **Paddle Serving** in Docker. For more images, please refer to [Docker Image List](Docker_Images_CN.md).
@@ -28,6 +34,7 @@
2834
| CUDA10.2 + cuDNN 7 | 0.9.0-cuda10.2-cudnn7-devel | Ubuntu 16 | 2.3.0-gpu-cuda10.2-cudnn7 | Ubuntu 18
2935
| CUDA10.2 + cuDNN 8 | 0.9.0-cuda10.2-cudnn8-devel | Ubuntu 16 | None | None |
3036
| CUDA11.2 + cuDNN 8 | 0.9.0-cuda11.2-cudnn8-devel | Ubuntu 16 | 2.3.0-gpu-cuda11.2-cudnn8 | Ubuntu 18 |
37+
| ARM + XPU | xpu-arm | CentOS 8.3 | None | None |
3138

3239
For **Windows 10 users**, please refer to the document [Paddle Serving Guide for Windows Platform](Windows_Tutorial_CN.md).
3340

@@ -36,46 +43,68 @@ For **Windows 10 users**, please refer to the document [Paddle Serving Guide for
3643

3744
### 1.1 Serving Devel Images (CPU/GPU 2 choose 1)
3845

46+
<a name="1.1.1"></a>
47+
3948
**CPU:**
4049
```
4150
# Start CPU Docker Container
4251
docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-devel
43-
docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
44-
docker exec -it test bash
52+
docker run -p 9292:9292 --name test_cpu -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
53+
docker exec -it test_cpu bash
4554
git clone https://github.com/PaddlePaddle/Serving
4655
```
56+
57+
<a name="1.1.2"></a>
58+
4759
**GPU:**
4860
```
4961
# Start GPU Docker Container
5062
docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel
51-
nvidia-docker run -p 9292:9292 --name test -dit docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel bash
52-
nvidia-docker exec -it test bash
63+
nvidia-docker run -p 9292:9292 --name test_gpu -dit docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel bash
64+
nvidia-docker exec -it test_gpu bash
65+
git clone https://github.com/PaddlePaddle/Serving
66+
```
67+
68+
<a name="1.1.3"></a>
69+
70+
**ARM & XPU: **
71+
```
72+
docker pull registry.baidubce.com/paddlepaddle/serving:xpu-arm
73+
docker run -p 9292:9292 --name test_arm_xpu -dit registry.baidubce.com/paddlepaddle/serving:xpu-arm bash
74+
docker exec -it test_arm_xpu bash
5375
git clone https://github.com/PaddlePaddle/Serving
5476
```
5577

5678
<a name="1.2"></a>
5779

5880
### 1.2 Paddle Devel Images (choose any codeblock of CPU/GPU)
81+
82+
<a name="1.2.1"></a>
83+
5984
**CPU:**
60-
```
85+
```shell
6186
# Start CPU Docker Container
6287
docker pull registry.baidubce.com/paddlepaddle/paddle:2.3.0
63-
docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0 bash
64-
docker exec -it test bash
88+
docker run -p 9292:9292 --name test_cpu -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0 bash
89+
docker exec -it test_cpu bash
6590
git clone https://github.com/PaddlePaddle/Serving
6691

67-
# Paddle dev image needs to run the following script to increase the dependencies required by Serving
92+
### Paddle dev image needs to run the following script to increase the dependencies required by Serving
6893
bash Serving/tools/paddle_env_install.sh
6994
```
95+
96+
<a name="1.2.2"></a>
97+
7098
**GPU:**
71-
```
72-
# Start GPU Docker
99+
100+
```shell
101+
### Start GPU Docker
73102
nvidia-docker pull registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8
74-
nvidia-docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8 bash
75-
nvidia-docker exec -it test bash
103+
nvidia-docker run -p 9292:9292 --name test_gpu -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8 bash
104+
nvidia-docker exec -it test_gpu bash
76105
git clone https://github.com/PaddlePaddle/Serving
77106

78-
# Paddle development image needs to execute the following script to increase the dependencies required by Serving
107+
### Paddle development image needs to execute the following script to increase the dependencies required by Serving
79108
bash Serving/tools/paddle_env_install.sh
80109
```
81110

@@ -98,6 +127,7 @@ Install the service whl package. There are three types of client, app and server
98127
<a name="2.1"></a>
99128

100129
### 2.1 Online Install
130+
Online installation uses `pypi` to download and install.
101131

102132
```shell
103133
pip3 install paddle-serving-client==0.9.0 -i https://pypi.tuna.tsinghua.edu.cn/simple
@@ -152,6 +182,7 @@ pip3 install https://paddle-inference-lib.bj.bcebos.com/2.3.0/python/Linux/GPU/x
152182
<a name="2.2"></a>
153183

154184
### 2.2 Offline Install
185+
Offline installation is to download all Paddle and Serving packages and dependent libraries, and install them in a no-network or weak-network environment.
155186

156187
**1.Install offline wheel packages**
157188

@@ -210,6 +241,22 @@ python3 install.py --cuda_version="" --python_version="py39" --device="cpu" --se
210241
python3 install.py --cuda_version="112" --python_version="py36" --device="GPU" --serving_version="no_install" --paddle_version="2.3.0"
211242
```
212243

244+
<a name="2.3"></a>
245+
246+
### 2.3 ARM & XPU Install
247+
248+
Since there are few users using ARM and XPU, the Wheel for installing this environment is provided separately as follows, among which `paddle_serving_client` only provides the `py36` version, if you need other versions, please contact us.
249+
```
250+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_app-0.9.0-py3-none-any.whl
251+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_client-0.9.0-cp36-none-any.whl
252+
pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
253+
```
254+
255+
Download binary package address:
256+
```
257+
wget https://paddle-serving.bj.bcebos.com/test-dev/bin/serving-xpu-aarch64-0.9.0.tar.gz
258+
```
259+
213260
<a name="3"></a>
214261

215262
## 3.Installation Check

doc/Latest_Packages_CN.md

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -48,22 +48,23 @@
4848
### Wheel包链接
4949

5050
适用ARM CPU环境的昆仑Wheel包:
51-
```
51+
52+
```shell
5253
# paddle-serving-server
53-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_server_xpu-0.0.0.post2-py3-none-any.whl
54+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_app-0.9.0-py3-none-any.whl
5455
# paddle-serving-client
55-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_client-0.0.0-cp36-none-any.whl
56+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_client-0.9.0-cp36-none-any.whl
5657
# paddle-serving-app
57-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_app-0.0.0-py3-none-any.whl
58+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
5859

5960
# SERVING BIN
60-
https://paddle-serving.bj.bcebos.com/bin/serving-xpu-aarch64-0.0.0.tar.gz
61+
wget https://paddle-serving.bj.bcebos.com/test-dev/bin/serving-xpu-aarch64-0.9.0.tar.gz
6162
```
6263

63-
适用于x86 CPU环境的昆仑Wheel包
64-
```
64+
适用于ARM & XPU 的 v0.9.0 版本 Wheel包
65+
```shell
6566
https://paddle-serving.bj.bcebos.com/test-dev/whl/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
66-
6767
```
6868

6969

70+

doc/Latest_Packages_EN.md

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -46,23 +46,22 @@ for kunlun user who uses arm-xpu or x86-xpu can download the wheel packages as f
4646

4747
### Wheel Package Links
4848

49-
for arm kunlun user
50-
```
49+
for arm kunlun user,
50+
```shell
5151
# paddle-serving-server
52-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_server_xpu-0.0.0.post2-py3-none-any.whl
52+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_app-0.9.0-py3-none-any.whl
5353
# paddle-serving-client
54-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_client-0.0.0-cp36-none-any.whl
54+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_client-0.9.0-cp36-none-any.whl
5555
# paddle-serving-app
56-
https://paddle-serving.bj.bcebos.com/whl/xpu/arm/paddle_serving_app-0.0.0-py3-none-any.whl
56+
wget https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
5757

5858
# SERVING BIN
59-
https://paddle-serving.bj.bcebos.com/bin/serving-xpu-aarch64-0.0.0.tar.gz
59+
wget https://paddle-serving.bj.bcebos.com/test-dev/bin/serving-xpu-aarch64-0.9.0.tar.gz
6060
```
6161

62-
for x86 kunlun user
63-
```
62+
for x86 xpu user, the wheel packages are here.
63+
```shell
6464
https://paddle-serving.bj.bcebos.com/test-dev/whl/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
65-
6665
```
6766

6867

0 commit comments

Comments
 (0)