[Feature]: Add NVFP4 KV cache support for SM120 in trtllm-gen

[lgreenlee]

🚀 The feature, motivation and pitch

Currently NVFP4 is only available for SM10X in trtllm-gen. It would be useful to have this feature available for consumer Blackwell chips that are SM120 based. The primary use is to allow more VRAM to be used for context.

Alternatives

There are no alternative solutions. I tried loading the cubins for SM100 on the SM120 but it did not work.

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

---

🧪 Issue enrichment is currently in open beta.

You can configure auto-planning by selecting labels in the issue_enrichment configuration.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!