We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 39a57ea commit c54e0d3Copy full SHA for c54e0d3
_posts/2025-12-03-intel-autoround-llmc.md
@@ -134,8 +134,8 @@ lm_eval --model vllm \
134
135
|Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
136
|-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
137
-|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.908|± |0.0091|
138
-| | |strict-match | 5|exact_match|↑ |0.907|± |0.0092|
+|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.911|± | 0.009|
+| | |strict-match | 5|exact_match|↑ |0.911|± | 0.009|
139
```
140
Note: The results may fluctuate due to non-determinism.
141
0 commit comments