|
11344 | 11344 | - filename: mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf |
11345 | 11345 | sha256: c5743c1bf39db0ae8a5ade5df0374b8e9e492754a199cfdad7ef393c1590f7c0 |
11346 | 11346 | uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf |
| 11347 | +- !!merge <<: *mistral03 |
| 11348 | + name: "mistralai_mistral-small-3.1-24b-instruct-2503-multimodal" |
| 11349 | + urls: |
| 11350 | + - https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503 |
| 11351 | + - https://huggingface.co/bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF |
| 11352 | + description: | |
| 11353 | + Building upon Mistral Small 3 (2501), Mistral Small 3.1 (2503) adds state-of-the-art vision understanding and enhances long context capabilities up to 128k tokens without compromising text performance. With 24 billion parameters, this model achieves top-tier capabilities in both text and vision tasks. |
| 11354 | + This model is an instruction-finetuned version of: Mistral-Small-3.1-24B-Base-2503. |
| 11355 | + |
| 11356 | + Mistral Small 3.1 can be deployed locally and is exceptionally "knowledge-dense," fitting within a single RTX 4090 or a 32GB RAM MacBook once quantized. |
| 11357 | + |
| 11358 | + This gallery entry includes mmproj for multimodality. |
| 11359 | + tags: |
| 11360 | + - llm |
| 11361 | + - gguf |
| 11362 | + - gpu |
| 11363 | + - mistral |
| 11364 | + - cpu |
| 11365 | + - function-calling |
| 11366 | + - multimodal |
| 11367 | + overrides: |
| 11368 | + parameters: |
| 11369 | + model: llama-cpp/models/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf |
| 11370 | + mmproj: llama-cpp/mmproj/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf |
| 11371 | + files: |
| 11372 | + - filename: llama-cpp/models/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf |
| 11373 | + sha256: c5743c1bf39db0ae8a5ade5df0374b8e9e492754a199cfdad7ef393c1590f7c0 |
| 11374 | + uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf |
| 11375 | + - filename: llama-cpp/mmproj/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf |
| 11376 | + sha256: f5add93ad360ef6ccba571bba15e8b4bd4471f3577440a8b18785f8707d987ed |
| 11377 | + uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mmproj-mistralai_Mistral-Small-3.1-24B-Instruct-2503-f16.gguf |
11347 | 11378 | - !!merge <<: *mistral03 |
11348 | 11379 | url: "github:mudler/LocalAI/gallery/chatml.yaml@master" |
11349 | 11380 | name: "gryphe_pantheon-rp-1.8-24b-small-3.1" |
|
0 commit comments