File tree Expand file tree Collapse file tree 1 file changed +15
-0
lines changed
docs/source-fabric/fundamentals Expand file tree Collapse file tree 1 file changed +15
-0
lines changed Original file line number Diff line number Diff line change @@ -90,6 +90,21 @@ Check out our before-and-after example for `image classification <https://github
90
90
----
91
91
92
92
93
+ ****************
94
+ Optional changes
95
+ ****************
96
+
97
+ Here are a few optional upgrades you can make to your code, if applicable:
98
+
99
+ - Replace ``torch.save() `` and ``torch.load() `` with Fabric's :doc: `save and load methods <../guide/checkpoint/checkpoint >`.
100
+ - Replace collective operations from ``torch.distributed `` (barrier, broadcast, etc.) with Fabric's :doc: `collective methods <../advanced/distributed_communication >`.
101
+ - Use Fabric's :doc: `no_backward_sync() context manager <../advanced/gradient_accumulation >` if you implemented gradient accumulation.
102
+ - Initialize your model under the :doc: `init_module() <../advanced/model_init >` context manager.
103
+
104
+
105
+ ----
106
+
107
+
93
108
**********
94
109
Next steps
95
110
**********
You can’t perform that action at this time.
0 commit comments