Skip to content

Commit 9579593

Browse files
author
pintaoz
committed
Add warning about not supporting
1 parent 903a5f2 commit 9579593

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

doc/frameworks/pytorch/using_pytorch.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -375,6 +375,8 @@ To initialize distributed training in your script, call
375375
`torch.distributed.init_process_group
376376
<https://pytorch.org/docs/master/distributed.html#torch.distributed.init_process_group>`_
377377
with the desired backend and the rank of the current host.
378+
Warning: ``torch.nn.SyncBatchNorm`` is not supported and its existence in
379+
``init_process_group`` will cause an exception during distributed training.
378380
379381
.. code:: python
380382

0 commit comments

Comments
 (0)