Skip to content

README.md

Latest commit

 

History

History
29 lines (20 loc) · 1.77 KB

README.md

File metadata and controls

29 lines (20 loc) · 1.77 KB

NVIDIA Brev Launchables for NeMo Agent Toolkit

Complexity: 🛑 Advanced

Brev Launchables are an easy way to bundle a hardware and software environment into an easily shareable link, allowing for simple demos of GPU-powered software. Click Deploy Now to get started!

NeMo Agent Toolkit offers the following notebooks in Brev Launchable format:

  1. GPU Cluster Sizing with NeMo-Agent-Toolkit Click here to deploy.

    • This notebook demonstrates how to use the NVIDIA NeMo Agent Toolkit sizing calculator to estimate the GPU cluster size required to accommodate a target number of users with a target response time. The estimation is based on the performance of the workflow at different concurrency levels.
    • The sizing calculator uses the evaluation and profiling systems in the NeMo Agent Toolkit.