Skip to content

Commit c032e04

Browse files
dtrifirodtrifiro
committed
mistralai/Mixtral-8x7B-Instruct-v0.1: set tensor-parallel-size=2
1 parent 736fd47 commit c032e04

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

‎mistralai/Mixtral-8x7B-Instruct-v0.1/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,4 @@
22
model: 'mistralai/Mixtral-8x7B-Instruct-v0.1'
33
trust-remote-code: true
44
max-model-len: 16384
5+
tensor-parallel: 2

0 commit comments

Comments
 (0)