File tree Expand file tree Collapse file tree 1 file changed +5
-1
lines changed
Expand file tree Collapse file tree 1 file changed +5
-1
lines changed Original file line number Diff line number Diff line change @@ -200,6 +200,10 @@ For advanced data preprocessing support including mixing and custom preprocessin
200200Model Name & Size | Model Architecture | Full Finetuning | Low Rank Adaptation (i.e. LoRA) | qLoRA(quantized LoRA) |
201201-------------------- | ---------------- | --------------- | ------------------------------- | --------------------- |
202202Granite PowerLM 3B | GraniteForCausalLM | ✅* | ✅* | ✅* |
203+ Granite 3.1 1B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
204+ Granite 3.1 2B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
205+ Granite 3.1 3B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
206+ Granite 3.1 8B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
203207Granite 3.0 2B | GraniteForCausalLM | ✔️* | ✔️* | ✔️* |
204208Granite 3.0 8B | GraniteForCausalLM | ✅* | ✅* | ✔️ |
205209GraniteMoE 1B | GraniteMoeForCausalLM | ✅ | ✅** | ? |
@@ -219,7 +223,7 @@ Mixtral 8x7B | Mixtral | ✅ | ✅ | ✅ |
219223Mistral-7b | Mistral | ✅ | ✅ | ✅ |
220224Mistral large | Mistral | 🚫 | 🚫 | 🚫 |
221225
222- (* ) - Supported with ` fms-hf-tuning ` v2.0.1 or later
226+ (* ) - Supported with ` fms-hf-tuning ` v2.4.0 or later.
223227
224228(** ) - Supported for q,k,v,o layers . ` all-linear ` target modules does not infer on vLLM yet.
225229
You can’t perform that action at this time.
0 commit comments