Skip to content

Commit 29bded2

Browse files
committed
CI for small LLM: use IBM Granite-4.0-H 1B
1 parent ee86993 commit 29bded2

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

.github/actions/prepare-llm/action.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,12 +6,12 @@ runs:
66
- name: Download and unpack llama.cpp
77
shell: bash
88
run: |
9-
curl -OL https://github.com/ggerganov/llama.cpp/releases/download/b4003/llama-b4003-bin-ubuntu-x64.zip
10-
unzip llama-b4003-bin-ubuntu-x64.zip
9+
curl -OL https://github.com/ggerganov/llama.cpp/releases/download/b6887/llama-b6887-bin-ubuntu-x64.zip
10+
unzip llama-b6887-bin-ubuntu-x64.zip
1111
1212
- name: Launch llama.cpp
1313
shell: bash
14-
run: ./build/bin/llama-server -c 4096 --hf-repo unsloth/SmolLM2-1.7B-Instruct-GGUF --hf-file SmolLM2-1.7B-Instruct-Q6_K.gguf &
14+
run: ./build/bin/llama-server -c 4096 --hf-repo unsloth/granite-4.0-h-1b-GGUF --hf-file granite-4.0-h-1b-IQ4_XS.gguf &
1515

1616
- name: Wait until it is ready
1717
shell: bash

0 commit comments

Comments
 (0)