Signed-off-by: noemotiovon <[email protected]>

* support interns1-mini

* fix comment

* update

ggml-ci

Signed-off-by: Weizhao Ouyang <[email protected]>

…5562)

* batched-bench : fix unified KV cache handling + pp timing

* cont : run dummy token only with split KV cache

…ml-org#15557)

* model-conversion: add model card template for embeddings [no ci]

This commit adds a separate model card template (model repository
README.md template) for embedding models.

The motivation for this is that there server command for the embedding
model is a little different and some addition information can be useful
in the model card for embedding models which might not be directly
relevant for causal models.

* squash! model-conversion: add model card template for embeddings [no ci]

Fix pyright lint error.

* remove --pooling override and clarify embd_normalize usage

…5564)

This commit explicitly sets the pooling type to 'none' in the logits.cpp
to support models that have a pooling type specified.

The motivation for this is that some models may have a pooling type set
in the model file (.gguf file) and for this specific case where we only
want to extract logits, we need to ensure that no pooling is used to
so that we are comparing raw logits and not pooled embeddings.

* CUDA: MoE helper in device code, better tile sizes

* reduce superfluous CUDA blocks

This avoids backend-dependent behavior for argmax that leads to intermittent failures.

…gml-org#15565)