Skip to content

Commit 451f6c5

Browse files
committed
add lb default
1 parent fe0cc35 commit 451f6c5

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

slime/backends/sglang_utils/arguments.py

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,18 @@ def add_sglang_router_arguments(parser):
2525
default=14400,
2626
help="Timeout for requests to the SGLang router in seconds",
2727
)
28+
parser.add_argument(
29+
"--sglang-router-balance-abs-threshold",
30+
type=int,
31+
default=10,
32+
help="Absolute threshold for balance in the SGLang router",
33+
)
34+
parser.add_argument(
35+
"--sglang-router-balance-rel-threshold",
36+
type=float,
37+
default=1.2,
38+
help="Relative threshold for balance in the SGLang router",
39+
)
2840
return parser
2941

3042

0 commit comments

Comments
 (0)