[AutoDeploy]: Nemotron-6 8K/16K (ISL/OSL) on H100; BF16 #8435
Description
🚀 The feature, motivation and pitch
capture nsys; compare to vLLM and identify issues.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.