-
Notifications
You must be signed in to change notification settings - Fork 2k
Open
Labels
InstallationSetting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.Setting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.InvestigatingtriagedIssue has been triaged by maintainersIssue has been triaged by maintainers
Description
System Info
System Information:
- OS: 16-Ubuntu
- Python version: Python 3.12.3
- CUDA version: cuda_12.9.r12.9/compiler.36037853_0
- GPU model(s): DGX Spark
- Driver version:
- TensorRT version:
- PyTorch version:
- TensorRT-LLM version:
Install the additional requirements
cd examples/quantization
pip install -r requirements.txt
Detailed output:
ERROR: Could not find a version that satisfies the requirement decord; extra == "all" (from nemo-toolkit[all]) (from versions: none)
ERROR: No matching distribution found for decord; extra == "all"
How you are installing TensorRT-LLM
Using the docker container: nvcr.io/nvidia/tensorrt-llm/release:spark-single-gpu-dev
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the installation documentation and examples for answers to frequently asked questions.
Metadata
Metadata
Assignees
Labels
InstallationSetting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.Setting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.InvestigatingtriagedIssue has been triaged by maintainersIssue has been triaged by maintainers