Skip to content

Commit 80a6657

Browse files
authored
Update config.yml
1 parent e87ca03 commit 80a6657

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

llmtune/config.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,8 +59,8 @@ training:
5959
optim: "paged_adamw_32bit"
6060
logging_steps: 1
6161
learning_rate: 2.0e-4
62-
bf16: true # Set to true for mixed precision training on Newer GPUs
63-
tf32: true
62+
bf16: true # [Ampere+] Set to true for mixed precision training on Newer GPUs
63+
tf32: true # [Ampere+] Set to true for mixed precision training on Newer GPUs
6464
# fp16: false # Set to true for mixed precision training on Older GPUs
6565
max_grad_norm: 0.3
6666
warmup_ratio: 0.03

0 commit comments

Comments
 (0)