Skip to content

Commit 3aca005

Browse files
authored
Update horovod.md (#2117)
1 parent aefb95d commit 3aca005

File tree

1 file changed

+5
-28
lines changed

1 file changed

+5
-28
lines changed

docs/tutorials/features/horovod.md

Lines changed: 5 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -3,34 +3,11 @@
33
Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed deep learning fast and easy to use. Horovod core principles are based on MPI concepts such as size, rank, local rank, allreduce, allgather, broadcast, and alltoall. To use Horovod with PyTorch, you need to install Horovod with Pytorch first, and make specific change for Horovod in your training script.
44

55
## Install Horovod with PyTorch
6-
### Set Compiler and CCL (assume you already install oneAPI basekit)
7-
8-
```bash
9-
source ${HOME}/intel/oneapi/compiler/latest/compiler/env/vars.sh
10-
source ${HOME}/intel/oneapi/ccl/latest/env/vars.sh
11-
```
12-
13-
### Build Horovod with PyTorch
14-
15-
```bash
16-
git clone -b xpu --depth=1 https://github.com/intel-innersource/frameworks.ai.horovod
17-
cd frameworks.ai.horovod
18-
git submodule sync
19-
git submodule update --init --recursive
20-
21-
I_MPI_CXX=dpcpp \
22-
CXX=mpicxx \
23-
LDSHARED="dpcpp -shared -fPIC" \
24-
CC=icx \
25-
HOROVOD_GPU=DPCPP \
26-
HOROVOD_WITHOUT_MXNET=1 \
27-
HOROVOD_WITHOUT_PYTORCH=0 \
28-
HOROVOD_WITHOUT_TENSORFLOW=1 \
29-
HOROVOD_WITHOUT_GLOO=1 \
30-
HOROVOD_GPU_OPERATIONS=CCL \
31-
HOROVOD_CPU_OPERATIONS=CCL \
32-
HOROVOD_WITH_MPI=1 python setup.py install
33-
```
6+
### Dependency
7+
- [Intel® Optimization for Horovod*](https://pypi.org/project/intel-extension-for-horovod)
8+
9+
You can use normal pip command to install the package:
10+
```python -m pip install intel-extension-for-horovod```
3411

3512
## Horovod with PyTorch Usage
3613
To use Horovod with PyTorch for XPU backend, make the following modifications to your training script:

0 commit comments

Comments
 (0)