Skip to content

Commit 981552e

Browse files
remove commented code (#1080)
Found this commented out code while debugging, this PR removes it.
1 parent 5e2033c commit 981552e

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

torchtitan/train.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -362,7 +362,6 @@ def train_step(self, input_dict: dict[str, torch.Tensor], labels: torch.Tensor):
362362
assert len(model_parts) == 1
363363
pred = model_parts[0](inputs)
364364
loss = self.loss_fn(pred, labels)
365-
# pred.shape=(bs, seq_len, vocab_size)
366365
# need to free to before bwd to avoid peaking memory
367366
del pred
368367
loss.backward()

0 commit comments

Comments
 (0)