We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e73db76 commit a11afc2Copy full SHA for a11afc2
lightllm/server/api_tgi.py
@@ -9,7 +9,7 @@
9
import json
10
11
12
-def format_tgi_params(params, num_beam: int):
+def format_tgi_params(params, num_beam: int = 1):
13
"""
14
tgi params format -> lightllm server params format
15
pub(crate) struct GenerateParameters {
0 commit comments