Skip to content

Commit 9354e7a

Browse files
committed
add pipeline parallel test scripts
1 parent 376acbd commit 9354e7a

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

scripts/test_config.json

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -116,6 +116,29 @@
116116
"tensor_parallel": 4,
117117
"sequence_parallel": true
118118
}
119+
},
120+
{
121+
"id": "6",
122+
"args": {
123+
"dtype": "float32",
124+
"nthread_per_process": 8,
125+
"num_iteration": 10,
126+
"batch_size": 10,
127+
"total_batch_size": 5120,
128+
"pipeline_parallel": 8
129+
}
130+
},
131+
{
132+
"id": "6_bfloat16",
133+
"args": {
134+
"dtype": "bfloat16",
135+
"nthread_per_process": 8,
136+
"num_iteration": 10,
137+
"batch_size": 10,
138+
"total_batch_size": 5120,
139+
"pipeline_parallel": 8
140+
}
119141
}
120142
]
121143
}
144+

0 commit comments

Comments
 (0)