File tree Expand file tree Collapse file tree 1 file changed +2
-3
lines changed
src/lightning/pytorch/strategies Expand file tree Collapse file tree 1 file changed +2
-3
lines changed Original file line number Diff line number Diff line change @@ -125,14 +125,13 @@ def __init__(
125
125
exclude_frozen_parameters : bool = False ,
126
126
) -> None :
127
127
"""Provides capabilities to run training using the DeepSpeed library, with training optimizations for large
128
- billion parameter models. `For more information: https://pytorch-
129
- lightning.readthedocs.io/en/stable/advanced/model_parallel.html#deepspeed`.
128
+ billion parameter models. *For more information:* :ref:`deepspeed_advanced`.
130
129
131
130
.. warning:: This is an :ref:`experimental <versioning:Experimental API>` feature.
132
131
133
132
Defaults have been set to enable ZeRO-Offload and some have been taken from the link below.
134
133
These defaults have been set generally, but may require tuning for optimum performance based on your model size.
135
- ` For more information: https://www.deepspeed.ai/docs/config-json/#zero-optimizations-for-fp16-training` .
134
+ * For more information:* https://www.deepspeed.ai/docs/config-json/#zero-optimizations-for-fp16-training.
136
135
137
136
Arguments:
138
137
You can’t perform that action at this time.
0 commit comments