Skip to content

Commit 08894ea

Browse files
dtrifirodtrifiro
committed
add rocm accuracy overrides for Mistral 24b and Ph
1 parent ba9cac2 commit 08894ea

File tree

4 files changed

+4
-0
lines changed

4 files changed

+4
-0
lines changed

‎RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-Dynamic/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
gpu_memory_utilization: 0.8

‎RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
gpu_memory_utilization: 0.8

‎RedHatAI/phi-4-FP8-dynamic/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
gpu_memory_utilization: 0.8

‎mistralai/Mistral-Small-24B-Instruct-2501/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
gpu_memory_utilization: 0.8

0 commit comments

Comments
 (0)