Skip to content

Commit aaadcf9

Browse files
authored
update param (#15)
Signed-off-by: Tarun Kumar <[email protected]>
1 parent 9ba8a48 commit aaadcf9

File tree

1 file changed

+10
-3
lines changed
  • meta-llama/Llama-3.1-8B-Instruct/performance

1 file changed

+10
-3
lines changed
Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,12 @@
11
data:
2-
prompt_tokens: 64
3-
output_tokens: 16
4-
rate-type: throughput
2+
prompt_tokens: 512
3+
prompt_tokens_stdev: 128
4+
prompt_tokens_min: 1
5+
prompt_tokens_max: 1024
6+
output_tokens: 256
7+
output_tokens_stdev: 64
8+
output_tokens_min: 1
9+
output_tokens_max: 1024
10+
rate-type: sweep
511
max-seconds: 400
12+
warmup-percent: 0.2

0 commit comments

Comments
 (0)