Skip to content

mxfp4模型要去哪里找? 除了gptoss20b和120b外我尝试加载了很多modelscope上的mxfp4模型,都报错,只有gpt的可以,请问是需要自己自行量化吗?能否告知是否存在qwen3系列的mxfp4量化模型(可以lmdeploy加载的) #4275

@sysugxh

Description

@sysugxh
No description provided.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions