Skip to content
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 25 additions & 14 deletions docsrc/getting_started/jetpack.rst
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,22 @@ System Preparation
sudo cp -a libcusparse_lt-linux-sbsa-0.5.2.1-archive/include/* /usr/local/cuda/include/
sudo cp -a libcusparse_lt-linux-sbsa-0.5.2.1-archive/lib/* /usr/local/cuda/lib64/

Building Torch-TensorRT
***********************
Installation Torch-TensorRT in JetPack
*************************************

You can directly install the torch-tensorrt wheel from the JPL repo which is built specifically for JetPack 6.2.

.. code-block:: sh
# verify tensorrt 10.3 is already installed via jetpack installation process
python -m pip list | grep tensorrt
# install torch-tensorrt wheel from JPL repo which is built specifically for JetPack 6.2
python -m pip install torch==2.8.0 torch_tensorrt==2.8.0 torchvision==0.24.0 --extra-index-url https://pypi.jetson-ai-lab.io/jp6/cu126


Building Torch-TensorRT in JetPack
*********************************

You can also build the torch-tensorrt wheel from the source code on your own.

Build Environment Setup
=======================
Expand Down Expand Up @@ -92,25 +106,22 @@ Build Environment Setup
# Can only install the torch and torchvision wheel from the JPL repo which is built specifically for JetPack 6.2
python -m pip install torch==2.8.0 torchvision==0.23.0 --index-url=https://pypi.jetson-ai-lab.io/jp6/cu126

4. **Build the Wheel**:

Building the Wheel
==================
.. code-block:: sh

.. code-block:: sh
python setup.py bdist_wheel --jetpack
python setup.py bdist_wheel --jetpack

Installation
============
5. **Install the Wheel**:

.. code-block:: sh
# you will be able to find the wheel in the dist directory, has platform name linux_tegra_aarch64
.. code-block:: sh

# you will be able to find the wheel in the dist directory
cd dist
python -m pip install torch_tensorrt-2.8.0.dev0+d8318d8fc-cp310-cp310-linux_tegra_aarch64.whl
python -m pip install torch_tensorrt-2.8.0.dev0+d8318d8fc-cp310-cp310-linux_aarch64.whl

Post-Installation Verification
==============================
6. **Verify installation by importing in Python**:

Verify installation by importing in Python:
.. code-block:: python

# verify whether the torch-tensorrt can be imported
Expand Down
6 changes: 6 additions & 0 deletions py/torch_tensorrt/_compile.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
import collections.abc
import logging
import platform
import warnings
from enum import Enum
from typing import Any, Callable, List, Optional, Sequence, Set, Union

Expand Down Expand Up @@ -121,6 +122,11 @@ def _get_target_fe(module_type: _ModuleType, ir: str) -> _IRType:
"Requested using the TS frontend but the TS frontend is not available in this build of Torch-TensorRT"
)
elif module_is_fxable and ir_targets_fx:
warnings.warn(
"FX frontend is deprecated. Please use the Dynamo frontend instead.",
DeprecationWarning,
stacklevel=2,
)
if ENABLED_FEATURES.fx_frontend:
return _IRType.fx
else:
Expand Down
Loading