We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
2 parents 66a760f + 3726e54 commit d5f0c1aCopy full SHA for d5f0c1a
docs/source-pytorch/data/alternatives.rst
@@ -99,7 +99,12 @@ The webdataset library contains a small wrapper (``WebLoader``) that adds a flui
99
import lightning as L
100
import webdataset as wds
101
102
- dataset = wds.WebDataset(urls)
+ dataset = wds.WebDataset(
103
+ urls,
104
+ # needed for multi-gpu or multi-node training
105
+ workersplitter=wds.shardlists.split_by_worker,
106
+ nodesplitter=wds.shardlists.split_by_node,
107
+ )
108
train_dataloader = wds.WebLoader(dataset)
109
110
model = ...
0 commit comments