Skip to content

Commit 2ce535f

Browse files
Update config.yaml
1 parent 252ee8f commit 2ce535f

File tree

1 file changed

+2
-2
lines changed
  • 11-embeddings-reranker-classification-tensorrt/Briton-qwen-qwq-32b-reasoning-fp8

1 file changed

+2
-2
lines changed

11-embeddings-reranker-classification-tensorrt/Briton-qwen-qwq-32b-reasoning-fp8/config.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,15 +3,15 @@ environment_variables: {}
33
external_package_dirs: []
44
model_metadata:
55
example_model_input:
6-
max_tokens: 512
6+
max_tokens: 2048
77
messages:
88
- content: Tell me everything you know about optimized inference.
99
role: user
1010
stream: true
1111
temperature: 0.5
1212
tags:
1313
- openai-compatible
14-
model_name: Briton-qwen-qwq-32b-reasoning-fp8-truss-example
14+
model_name: Qwen QwQ 32B
1515
python_version: py39
1616
requirements: []
1717
resources:

0 commit comments

Comments
 (0)