Skip to content

Commit 34bb787

Browse files
ilopezlunadoringeman
authored andcommitted
Update workflow to support mmproj (docker#112)
* adds --mmproj param * Update workflow to support mmproj * Try to copy mmproj if exists * Try to copy mmproj if exists * Try to copy mmproj if exists * Try to copy mmproj if exists * Try to copy mmproj if exists
1 parent db57d83 commit 34bb787

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

pkg/distribution/README.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,10 @@ make build
3434
./bin/model-distribution-tool package --licenses license1.txt --licenses license2.txt ./model.gguf registry.example.com/models/llama:v1.0
3535

3636
# Package a model with a default context size and push to a registry
37-
./bin/model-distribution-tool ./model.gguf --context-size 2048 registry.example.com/models/llama:v1.0
37+
./bin/model-distribution-tool package ./model.gguf --context-size 2048 registry.example.com/models/llama:v1.0
38+
39+
# Package a model with a multimodal projector file and push to a registry
40+
./bin/model-distribution-tool package ./model.gguf --mmproj ./model.mmproj registry.example.com/models/llama:v1.0
3841

3942
# Push a model from the content store to the registry
4043
./bin/model-distribution-tool push registry.example.com/models/llama:v1.0
@@ -158,6 +161,7 @@ Use the **Package GGUF model** workflow to download a pre-built GGUF model and p
158161
- **Registry repository**: `smollm2`
159162
- **Tag**: `135M-Q4_K_M`
160163
- **License URL**: `https://huggingface.co/datasets/choosealicense/licenses/resolve/main/markdown/apache-2.0.md`
164+
- **MMPROJ URL**: (optional) URL to multimodal projector file if the model supports multimodal features
161165

162166
This will create: `aistaging/smollm2:135M-Q4_K_M`
163167

@@ -169,7 +173,8 @@ For packaging multiple models at once, use the `models_json` input:
169173
"gguf_url": "https://huggingface.co/unsloth/Qwen3-32B-GGUF/resolve/main/Qwen3-32B-Q4_K_XL.gguf",
170174
"repository": "qwen3-gguf",
171175
"tag": "32B-Q4_K_XL",
172-
"license_url": "https://huggingface.co/datasets/choosealicense/licenses/resolve/main/markdown/apache-2.0.md"
176+
"license_url": "https://huggingface.co/datasets/choosealicense/licenses/resolve/main/markdown/apache-2.0.md",
177+
"mmproj_url": "https://huggingface.co/unsloth/Qwen3-32B-GGUF/resolve/main/Qwen3-32B-Q4_K_XL.mmproj"
173178
},
174179
{
175180
"gguf_url": "https://huggingface.co/unsloth/Qwen3-32B-GGUF/resolve/main/Qwen3-32B-Q8_0.gguf",

0 commit comments

Comments
 (0)