Skip to content

Commit d505a97

Browse files
authored
Fix qwen benchmark (#8969)
1 parent fbe1fae commit d505a97

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

tests/test_tipc/dygraph/hybrid_parallelism/qwen/N4C32/qwen-qwen-14b_seqlen4096_pretrain_bs32_bf16_MP2-PP1-sharding16-mbs1-acc2.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ param+="data_parallel_degree=1 "
1919
param+="tensor_parallel_degree=2 "
2020
param+="pipeline_parallel_degree=1 "
2121
param+="virtual_pp_degree=1 "
22-
param+="sequence_parallel=0 "
22+
param+="sequence_parallel=1 "
2323
param+="sharding_parallel_degree=16 "
2424
param+="sharding=stage1 "
2525
param+="recompute=0 "

tests/test_tipc/dygraph/hybrid_parallelism/qwen/N4C32/qwen-qwen-7b_seqlen4096_pretrain_bs32_bf16_MP1-PP1-sharding32-mbs1-acc1.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ param+="data_parallel_degree=1 "
1919
param+="tensor_parallel_degree=1 "
2020
param+="pipeline_parallel_degree=1 "
2121
param+="virtual_pp_degree=1 "
22-
param+="sequence_parallel=1 "
22+
param+="sequence_parallel=0 "
2323
param+="sharding_parallel_degree=32 "
2424
param+="sharding=stage1 "
2525
param+="recompute=0 "

0 commit comments

Comments
 (0)