Skip to content

Commit d03072b

Browse files
authored
docs: update granite3 model support (#441)
Signed-off-by: Anh Uong <[email protected]>
1 parent 28c3d38 commit d03072b

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

README.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -200,6 +200,10 @@ For advanced data preprocessing support including mixing and custom preprocessin
200200
Model Name & Size | Model Architecture | Full Finetuning | Low Rank Adaptation (i.e. LoRA) | qLoRA(quantized LoRA) |
201201
-------------------- | ---------------- | --------------- | ------------------------------- | --------------------- |
202202
Granite PowerLM 3B | GraniteForCausalLM | ✅* | ✅* | ✅* |
203+
Granite 3.1 1B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
204+
Granite 3.1 2B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
205+
Granite 3.1 3B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
206+
Granite 3.1 8B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
203207
Granite 3.0 2B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
204208
Granite 3.0 8B | GraniteForCausalLM | ✅* | ✅* | ✔️ |
205209
GraniteMoE 1B | GraniteMoeForCausalLM | ✅ | ✅** | ? |
@@ -219,7 +223,7 @@ Mixtral 8x7B | Mixtral | ✅ | ✅ | ✅ |
219223
Mistral-7b | Mistral | ✅ | ✅ | ✅ |  
220224
Mistral large | Mistral | 🚫 | 🚫 | 🚫 |
221225

222-
(*) - Supported with `fms-hf-tuning` v2.0.1 or later
226+
(*) - Supported with `fms-hf-tuning` v2.4.0 or later.
223227

224228
(**) - Supported for q,k,v,o layers . `all-linear` target modules does not infer on vLLM yet.
225229

0 commit comments

Comments
 (0)