Skip to content

Commit 5d6688d

Browse files
authored
model-conversion : add --embeddings flag to modelcard.template [no ci] (ggml-org#15801)
This commit updates the modelcard.template file used in the model conversion scripts for embedding models to include the llama-server --embeddings flag in the recommended command to run the model. The motivation for this change was that when using the model-conversion "tool" to upload the EmbeddingGemma models to Hugging Face this flag was missing and the embedding endpoint was there for not available when copy&pasting the command.
1 parent 4fd1242 commit 5d6688d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/model-conversion/scripts/embedding/modelcard.template

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ base_model:
77
Recommended way to run this model:
88

99
```sh
10-
llama-server -hf {namespace}/{model_name}-GGUF
10+
llama-server -hf {namespace}/{model_name}-GGUF --embeddings
1111
```
1212

1313
Then the endpoint can be accessed at http://localhost:8080/embedding, for

0 commit comments

Comments
 (0)