We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 25f5b74 commit 4f3f350Copy full SHA for 4f3f350
scripts/train/finetune_clip.sh scripts/train/direct_finetune_clip.shscripts/train/finetune_clip.sh renamed to scripts/train/direct_finetune_clip.sh
@@ -62,4 +62,4 @@ ACCELERATE_CPU_AFFINITY=1 torchrun --nproc_per_node="${NUM_GPUS}" --nnodes="${NN
62
--dataloader_drop_last True \
63
--attn_implementation sdpa
64
65
-# You can delete the sdpa attn_implementation if you want to use flash attn
+# You can delete the sdpa attn_implementation if you want to use flash attn
0 commit comments