Skip to content

Conversation

@meenchen
Copy link
Contributor

@meenchen meenchen commented Nov 6, 2025

What does this PR do?

Type of change: ?

Adding AWQ fake quant support for vLLM MoE models.

Overview: ?

Usage

Run NVFP4_AWQ_LITE_CFG config with moe models

Testing

Test a few samples for Qwen3 moe models and NVFP4_AWQ_LITE_CFG

Before your PR is "Ready for review"

  • Make sure you read and follow Contributor guidelines and your commits are signed.
  • Is this change backward compatible?: Yes/No
  • Did you write any new necessary tests?: Yes/No
  • Did you add or update any necessary documentation?: Yes/No
  • Did you update Changelog?: Yes/No

Additional Information

Signed-off-by: weimingc <[email protected]>
Signed-off-by: weimingc <[email protected]>
@meenchen meenchen self-assigned this Nov 6, 2025
@copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 6, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants