Skip to content

[Feature]: AutoDeploy: Fully-fledged GPT-OSS support #9460

@Fridah-nv

Description

@Fridah-nv

🚀 The feature, motivation and pitch

  1. mxfp4 moe reference op that is supported ootb on main
  2. Mxfp4 moe optimized backends: triton vs cutlass kernels
  3. 1 unquantized reference op instead of 2

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

Metadata

Metadata

Assignees

Labels

AutoDeploy<NV> AutoDeploy Backendfeature requestNew feature or request. This includes new model, dtype, functionality support

Type

No type

Projects

Status

In progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions