Skip to content

llama.cpp : add --n-cpu-moe option #840

@anzax

Description

@anzax

Please give us ability to set new --n-cpu-moe value for llama.cpp
ggml-org/llama.cpp#15077

It is mandatory for new MOE OpenAI open models and GLM-4.5
It would be really nice to be able to pass args to llama.cpp so you don't need to add new controls to UI all the time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions