Skip to content

Commit 0d3dcfc

Browse files
committed
fix
Signed-off-by: yiliu30 <[email protected]>
1 parent e823e92 commit 0d3dcfc

File tree

1 file changed

+3
-4
lines changed

1 file changed

+3
-4
lines changed

_posts/2025-12-03-intel-autoround-llmc.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -126,13 +126,12 @@ Note: please install vLLM from this PR https://github.com/vllm-project/vllm/pull
126126

127127
```bash
128128
lm_eval --model vllm \
129-
--model_args pretrained="./Qwen3-8B-W4A16-G128-AutoRound,add_bos_token=true,max_model_len=8192,max_num_batched_tokens=32768,max_num_seqs=128,add_bos_token=True,gpu_memory_utilization=0.8,dtype=bfloat16,max_gen_toks=2048,enable_prefix_caching=False,enforce_eager=True" \
129+
--model_args pretrained="./Qwen3-8B-W4A16-G128-AutoRound,max_model_len=8192,max_num_batched_tokens=32768,max_num_seqs=128,gpu_memory_utilization=0.8,dtype=bfloat16,max_gen_toks=2048,enable_prefix_caching=False,enforce_eager=True" \
130130
--tasks gsm8k \
131131
--num_fewshot 5 \
132132
--limit 1000 \
133-
--batch_size 'auto'
134-
```
135-
```bash
133+
--batch_size 128
134+
136135
|Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
137136
|-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
138137
|gsm8k| 3|flexible-extract| 5|exact_match||0.908|± |0.0091|

0 commit comments

Comments
 (0)