Skip to content

Commit 49a294d

Browse files
committed
CI for Spanish tests: limit the models
The focus is to prioritize: * the smallest variant of the same model * 32K context length or more * best cost for token generation
1 parent 2f8069e commit 49a294d

File tree

1 file changed

+0
-32
lines changed

1 file changed

+0
-32
lines changed

.github/workflows/spanish.yml

Lines changed: 0 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -12,29 +12,13 @@ jobs:
1212
fail-fast: false
1313
matrix:
1414
model:
15-
- meta-llama/llama-3.2-3b-instruct # $0.0100/$0.0200 [ 128K]
16-
- mistralai/mistral-nemo # $0.0100/$0.0270 [ 128K]
1715
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
1816
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
1917
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
20-
- mistralai/mistral-7b-instruct-v0.3 # $0.0280/$0.0540 [ 32K]
2118
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
2219
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
23-
- microsoft/phi-3-mini-128k-instruct # $0.1000/$0.1000 [ 128K]
2420
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
25-
- amazon/nova-micro-v1 # $0.0350/$0.1400 [ 128K]
26-
- microsoft/phi-4 # $0.0700/$0.1400 [ 16K]
2721
- google/gemini-flash-1.5-8b # $0.0380/$0.1500 [1000K]
28-
- amazon/nova-lite-v1 # $0.0600/$0.2400 [ 300K]
29-
- qwen/qwen3-14b # $0.0800/$0.2400 [ 40K]
30-
- mistralai/mixtral-8x7b-instruct # $0.2400/$0.2400 [ 32K]
31-
- meta-llama/llama-3.3-70b-instruct # $0.0700/$0.2500 [ 128K]
32-
- qwen/qwen3-30b-a3b # $0.0800/$0.2900 [ 40K]
33-
- google/gemini-2.0-flash-lite-001 # $0.0750/$0.3000 [1000K]
34-
- meta-llama/llama-4-scout # $0.0800/$0.3000 [ 320K]
35-
- google/gemini-2.0-flash-001 # $0.1000/$0.4000 [1000K]
36-
- openai/gpt-4.1-nano # $0.1000/$0.4000 [1000K]
37-
- google/gemini-2.5-flash-lite-preview-06-17 # $0.1000/$0.4000 [1000K]
3822

3923
steps:
4024
- uses: actions/checkout@v4
@@ -60,29 +44,13 @@ jobs:
6044
fail-fast: false
6145
matrix:
6246
model:
63-
- meta-llama/llama-3.2-3b-instruct # $0.0100/$0.0200 [ 128K]
64-
- mistralai/mistral-nemo # $0.0100/$0.0270 [ 128K]
6547
- google/gemma-3n-e4b-it # $0.0200/$0.0400 [ 32K]
6648
- google/gemma-3-4b-it # $0.0200/$0.0400 [ 128K]
6749
- mistralai/ministral-3b # $0.0400/$0.0400 [ 128K]
68-
- mistralai/mistral-7b-instruct-v0.3 # $0.0280/$0.0540 [ 32K]
6950
- mistralai/mistral-small-3.2-24b-instruct # $0.0500/$0.1000 [ 32K]
7051
- google/gemma-3-12b-it # $0.0500/$0.1000 [ 128K]
71-
- microsoft/phi-3-mini-128k-instruct # $0.1000/$0.1000 [ 128K]
7252
- qwen/qwen3-8b # $0.0350/$0.1380 [ 128K]
73-
- amazon/nova-micro-v1 # $0.0350/$0.1400 [ 128K]
74-
- microsoft/phi-4 # $0.0700/$0.1400 [ 16K]
7553
- google/gemini-flash-1.5-8b # $0.0380/$0.1500 [1000K]
76-
- amazon/nova-lite-v1 # $0.0600/$0.2400 [ 300K]
77-
- qwen/qwen3-14b # $0.0800/$0.2400 [ 40K]
78-
- mistralai/mixtral-8x7b-instruct # $0.2400/$0.2400 [ 32K]
79-
- meta-llama/llama-3.3-70b-instruct # $0.0700/$0.2500 [ 128K]
80-
- qwen/qwen3-30b-a3b # $0.0800/$0.2900 [ 40K]
81-
- google/gemini-2.0-flash-lite-001 # $0.0750/$0.3000 [1000K]
82-
- meta-llama/llama-4-scout # $0.0800/$0.3000 [ 320K]
83-
- google/gemini-2.0-flash-001 # $0.1000/$0.4000 [1000K]
84-
- openai/gpt-4.1-nano # $0.1000/$0.4000 [1000K]
85-
- google/gemini-2.5-flash-lite-preview-06-17 # $0.1000/$0.4000 [1000K]
8654

8755
steps:
8856
- uses: actions/checkout@v4

0 commit comments

Comments
 (0)