Skip to content

Commit 1a7b8ad

Browse files
ariyaariya
committed
For language-specific tests, rely on Ministral 3B
Since its context window is 128K and its smaller than other Mistral family, Ministral 3B should be the representative.
1 parent f5fa74a commit 1a7b8ad

File tree

5 files changed

+8
-12
lines changed

5 files changed

+8
-12
lines changed

‎.github/workflows/english.yml‎

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,6 @@ jobs:
1717
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1818
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
1919
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
20-
- mistralai/mistral-7b-instruct-v0.3 # $0.0280/$0.0540 [ 32K]
21-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
2220
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
2321
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
2422
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
@@ -62,8 +60,6 @@ jobs:
6260
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
6361
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
6462
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
65-
- mistralai/mistral-7b-instruct-v0.3 # $0.0280/$0.0540 [ 32K]
66-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
6763
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
6864
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
6965
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]

‎.github/workflows/french.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ jobs:
1515
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
1616
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1717
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
18-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
18+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
1919
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
2020
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
2121
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
@@ -47,7 +47,7 @@ jobs:
4747
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
4848
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
4949
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
50-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
50+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
5151
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
5252
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
5353
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]

‎.github/workflows/german.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ jobs:
1515
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
1616
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1717
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
18-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
18+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
1919
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
2020
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
2121
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
@@ -47,7 +47,7 @@ jobs:
4747
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
4848
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
4949
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
50-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
50+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
5151
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
5252
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
5353
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]

‎.github/workflows/italian.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ jobs:
1414
model:
1515
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1616
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
17-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
17+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
1818
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
1919
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
2020

@@ -44,7 +44,7 @@ jobs:
4444
model:
4545
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
4646
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
47-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
47+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
4848
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
4949
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
5050

‎.github/workflows/spanish.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ jobs:
1515
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
1616
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1717
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
18-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
18+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
1919
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
2020
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
2121
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
@@ -47,7 +47,7 @@ jobs:
4747
- meta-llama/llama-3.2-3b-instruct # $0.0200/$0.0200 [ 128K]
4848
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
4949
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
50-
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
50+
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
5151
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
5252
- ibm-granite/granite-4.0-h-micro # $0.0170/$0.1100 [ 128K]
5353
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]

0 commit comments

Comments
 (0)