44
55- [ 1.Use devel docker] ( #1 )
66 - [ Serving devel images] ( #1.1 )
7+ - [ CPU images] ( #1.1.1 )
8+ - [ GPU images] ( #1.1.2 )
9+ - [ ARM & XPU images] ( #1.1.3 )
710 - [ Paddle devel images] ( #1.2 )
11+ - [ CPU images] ( #1.2.1 )
12+ - [ GPU images] ( #1.2.2 )
813- [ 2.Install Wheel Packages] ( #2 )
914 - [ Online Install] ( #2.1 )
1015 - [ Offline Install] ( #2.2 )
16+ - [ ARM & XPU Install] ( #2.3 )
1117- [ 3.Installation Check] ( #3 )
1218
1319** Strongly recommend** you build ** Paddle Serving** in Docker. For more images, please refer to [ Docker Image List] ( Docker_Images_CN.md ) .
2834| CUDA10.2 + cuDNN 7 | 0.9.0-cuda10.2-cudnn7-devel | Ubuntu 16 | 2.3.0-gpu-cuda10.2-cudnn7 | Ubuntu 18
2935| CUDA10.2 + cuDNN 8 | 0.9.0-cuda10.2-cudnn8-devel | Ubuntu 16 | None | None |
3036| CUDA11.2 + cuDNN 8 | 0.9.0-cuda11.2-cudnn8-devel | Ubuntu 16 | 2.3.0-gpu-cuda11.2-cudnn8 | Ubuntu 18 |
37+ | ARM + XPU | xpu-arm | CentOS 8.3 | None | None |
3138
3239For ** Windows 10 users** , please refer to the document [ Paddle Serving Guide for Windows Platform] ( Windows_Tutorial_CN.md ) .
3340
@@ -36,46 +43,68 @@ For **Windows 10 users**, please refer to the document [Paddle Serving Guide for
3643
3744### 1.1 Serving Devel Images (CPU/GPU 2 choose 1)
3845
46+ <a name =" 1.1.1 " ></a >
47+
3948** CPU:**
4049```
4150# Start CPU Docker Container
4251docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-devel
43- docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
44- docker exec -it test bash
52+ docker run -p 9292:9292 --name test_cpu -dit registry.baidubce.com/paddlepaddle/serving:0.9.0-devel bash
53+ docker exec -it test_cpu bash
4554git clone https://github.com/PaddlePaddle/Serving
4655```
56+
57+ <a name =" 1.1.2 " ></a >
58+
4759** GPU:**
4860```
4961# Start GPU Docker Container
5062docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel
51- nvidia-docker run -p 9292:9292 --name test -dit docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel bash
52- nvidia-docker exec -it test bash
63+ nvidia-docker run -p 9292:9292 --name test_gpu -dit docker pull registry.baidubce.com/paddlepaddle/serving:0.9.0-cuda11.2-cudnn7-devel bash
64+ nvidia-docker exec -it test_gpu bash
65+ git clone https://github.com/PaddlePaddle/Serving
66+ ```
67+
68+ <a name =" 1.1.3 " ></a >
69+
70+ ** ARM & XPU: **
71+ ```
72+ docker pull registry.baidubce.com/paddlepaddle/serving:xpu-arm
73+ docker run -p 9292:9292 --name test_arm_xpu -dit registry.baidubce.com/paddlepaddle/serving:xpu-arm bash
74+ docker exec -it test_arm_xpu bash
5375git clone https://github.com/PaddlePaddle/Serving
5476```
5577
5678<a name =" 1.2 " ></a >
5779
5880### 1.2 Paddle Devel Images (choose any codeblock of CPU/GPU)
81+
82+ <a name =" 1.2.1 " ></a >
83+
5984** CPU:**
60- ```
85+ ``` shell
6186# Start CPU Docker Container
6287docker pull registry.baidubce.com/paddlepaddle/paddle:2.3.0
63- docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0 bash
64- docker exec -it test bash
88+ docker run -p 9292:9292 --name test_cpu -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0 bash
89+ docker exec -it test_cpu bash
6590git clone https://github.com/PaddlePaddle/Serving
6691
67- # Paddle dev image needs to run the following script to increase the dependencies required by Serving
92+ # ## Paddle dev image needs to run the following script to increase the dependencies required by Serving
6893bash Serving/tools/paddle_env_install.sh
6994```
95+
96+ <a name =" 1.2.2 " ></a >
97+
7098** GPU:**
71- ```
72- # Start GPU Docker
99+
100+ ``` shell
101+ # ## Start GPU Docker
73102nvidia-docker pull registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8
74- nvidia-docker run -p 9292:9292 --name test -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8 bash
75- nvidia-docker exec -it test bash
103+ nvidia-docker run -p 9292:9292 --name test_gpu -dit registry.baidubce.com/paddlepaddle/paddle:2.3.0-gpu-cuda11.2-cudnn8 bash
104+ nvidia-docker exec -it test_gpu bash
76105git clone https://github.com/PaddlePaddle/Serving
77106
78- # Paddle development image needs to execute the following script to increase the dependencies required by Serving
107+ # ## Paddle development image needs to execute the following script to increase the dependencies required by Serving
79108bash Serving/tools/paddle_env_install.sh
80109```
81110
@@ -98,6 +127,7 @@ Install the service whl package. There are three types of client, app and server
98127<a name =" 2.1 " ></a >
99128
100129### 2.1 Online Install
130+ Online installation uses ` pypi ` to download and install.
101131
102132``` shell
103133pip3 install paddle-serving-client==0.9.0 -i https://pypi.tuna.tsinghua.edu.cn/simple
@@ -152,6 +182,7 @@ pip3 install https://paddle-inference-lib.bj.bcebos.com/2.3.0/python/Linux/GPU/x
152182<a name =" 2.2 " ></a >
153183
154184### 2.2 Offline Install
185+ Offline installation is to download all Paddle and Serving packages and dependent libraries, and install them in a no-network or weak-network environment.
155186
156187** 1.Install offline wheel packages**
157188
@@ -210,6 +241,22 @@ python3 install.py --cuda_version="" --python_version="py39" --device="cpu" --se
210241python3 install.py --cuda_version="112" --python_version="py36" --device="GPU" --serving_version="no_install" --paddle_version="2.3.0"
211242```
212243
244+ <a name =" 2.3 " ></a >
245+
246+ ### 2.3 ARM & XPU Install
247+
248+ Since there are few users using ARM and XPU, the Wheel for installing this environment is provided separately as follows, among which ` paddle_serving_client ` only provides the ` py36 ` version, if you need other versions, please contact us.
249+ ```
250+ pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_app-0.9.0-py3-none-any.whl
251+ pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_client-0.9.0-cp36-none-any.whl
252+ pip3.6 install https://paddle-serving.bj.bcebos.com/test-dev/whl/arm/paddle_serving_server_xpu-0.9.0.post2-py3-none-any.whl
253+ ```
254+
255+ Download binary package address:
256+ ```
257+ wget https://paddle-serving.bj.bcebos.com/test-dev/bin/serving-xpu-aarch64-0.9.0.tar.gz
258+ ```
259+
213260<a name =" 3 " ></a >
214261
215262## 3.Installation Check
0 commit comments