Skip to content

Commit ae29145

Browse files
committed
Increase GLM context len to 200k.
1 parent 65df760 commit ae29145

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

GLM-4.7.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ services:
7575
command: >
7676
zai-org/GLM-4.7
7777
--tensor-parallel-size 8
78-
--max-model-len 128K
78+
--max-model-len 200K
7979
--max-num-batched-tokens 32K
8080
--max-num-seqs 128
8181
--stream-interval 6

0 commit comments

Comments
 (0)