You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
description: Timeout for the Embeddings request in seconds. This parameter is currently ignored for Vertex AI models.
179
+
type: integer
180
+
default: 600
181
+
minimum: 1
182
+
maximum: 600
183
+
max_retries:
184
+
description: Maximum number of retries for the Embeddings request. This parameter is currently ignored for Vertex AI models.
185
+
type: integer
186
+
default: 2
187
+
minimum: 0
188
+
maximum: 5
177
189
EmbeddingsModelParams:
178
190
type: object
179
191
description: Additional parameters for generating input's embeddings. Default values are used for mandatory parameters.
@@ -828,6 +840,18 @@ components:
828
840
n: 2
829
841
stream_options:
830
842
include_usage: true
843
+
timeout:
844
+
description: Timeout for the LLM request in seconds. This parameter is currently ignored for Vertex AI models.
845
+
type: integer
846
+
default: 600
847
+
minimum: 1
848
+
maximum: 600
849
+
max_retries:
850
+
description: Maximum number of retries for the LLM request. This parameter is currently ignored for Vertex AI models.
851
+
type: integer
852
+
default: 2
853
+
minimum: 0
854
+
maximum: 5
831
855
832
856
# --- Templating Module with User Defined Template ---
833
857
# response_format api definition taken from: https://github.com/openai/openai-openapi/blob/e0cb2d721753e13e69e918465795d6e9f87ab15a/openapi.yaml#L12286
0 commit comments