Skip to content

Commit dc8d99f

Browse files
committed
auto-sync flag was renamed
1 parent 1f94fc4 commit dc8d99f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

train/tr11-176B-ml/tr11-176B-ml.slurm

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ GPT_ARGS=" \
115115
--tokenizer-name-or-path $TOKENIZER_NAME_OR_PATH \
116116
--init-method-std 0.0048 \
117117
--embed-layernorm \
118-
--layernorm-tp-auto-sync \
118+
--sync-tp-duplicated-parameters \
119119
--bf16 \
120120
--seed 42 \
121121
--position-embedding-type alibi \

0 commit comments

Comments
 (0)