addtesnor

Signed-off-by: Tarun Kumar <[email protected]>

Author: tarukumar

accuracy/Meta-Llama-3.1-8B-Instruct/server.yml

@@ -2,4 +2,5 @@
 model: "meta-llama/Meta-Llama-3.1-8B-Instruct"
 trust-remote-code: true
 enable-chunked-prefill: true
+tensor-parallel-size:
 max-model-len: 4096