Skip to content

Commit ff5a54b

Browse files
authored
chore(model gallery): Add entry for Mistral Small 3.1 with mmproj (#8247)
* chore(model gallery): Add entry for Mistral Small 3.1 with mmproj Signed-off-by: rampa3 <68955305+rampa3@users.noreply.github.com> * Use llama-cpp subfolder structure akin to Qwen 3 VL Signed-off-by: rampa3 <68955305+rampa3@users.noreply.github.com> --------- Signed-off-by: rampa3 <68955305+rampa3@users.noreply.github.com>
1 parent 3c1f823 commit ff5a54b

File tree

1 file changed

+31
-0
lines changed

1 file changed

+31
-0
lines changed

gallery/index.yaml

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11344,6 +11344,37 @@
1134411344
- filename: mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
1134511345
sha256: c5743c1bf39db0ae8a5ade5df0374b8e9e492754a199cfdad7ef393c1590f7c0
1134611346
uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
11347+
- !!merge <<: *mistral03
11348+
name: "mistralai_mistral-small-3.1-24b-instruct-2503-multimodal"
11349+
urls:
11350+
- https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503
11351+
- https://huggingface.co/bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF
11352+
description: |
11353+
Building upon Mistral Small 3 (2501), Mistral Small 3.1 (2503) adds state-of-the-art vision understanding and enhances long context capabilities up to 128k tokens without compromising text performance. With 24 billion parameters, this model achieves top-tier capabilities in both text and vision tasks.
11354+
This model is an instruction-finetuned version of: Mistral-Small-3.1-24B-Base-2503.
11355+
11356+
Mistral Small 3.1 can be deployed locally and is exceptionally "knowledge-dense," fitting within a single RTX 4090 or a 32GB RAM MacBook once quantized.
11357+
11358+
This gallery entry includes mmproj for multimodality.
11359+
tags:
11360+
- llm
11361+
- gguf
11362+
- gpu
11363+
- mistral
11364+
- cpu
11365+
- function-calling
11366+
- multimodal
11367+
overrides:
11368+
parameters:
11369+
model: llama-cpp/models/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
11370+
mmproj: llama-cpp/mmproj/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf
11371+
files:
11372+
- filename: llama-cpp/models/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
11373+
sha256: c5743c1bf39db0ae8a5ade5df0374b8e9e492754a199cfdad7ef393c1590f7c0
11374+
uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
11375+
- filename: llama-cpp/mmproj/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf
11376+
sha256: f5add93ad360ef6ccba571bba15e8b4bd4471f3577440a8b18785f8707d987ed
11377+
uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf
1134711378
- !!merge <<: *mistral03
1134811379
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
1134911380
name: "gryphe_pantheon-rp-1.8-24b-small-3.1"

0 commit comments

Comments
 (0)