Skip to content

[Feature Request]: InfLLM v2特性是否与主流推理框架(如vLLM或SGLang)适配? #312

@2018112767

Description

@2018112767

Feature request / 功能建议

使用vLLM或SGLang运行MiniCPM4模型时,能否开启InfLLM v2特性。如果目前不能,后续是否会发布适配MiniCPM4的vLLM或SGLang项目?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions