You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
## Building a docker container for Torch-TensorRT Preview
16
+
17
+
We provide a `Dockerfile` in `docker/` directory. We build `Torch-TensorRT` on top of a `Pytorch NGC container` which provide basic dependencies (like CUDA, CUDNN, CUBLAS, TensorRT, Pytorch and others) The dependency libraries in the container can be found in the <ahref="https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/index.html">release notes</a>.
18
+
19
+
Please follow this instruction to build a Docker container.
| Linux aarch64 / GPU |**Native Compilation Supported on JetPack-4.4+**|
71
88
| Linux aarch64 / DLA |**Native Compilation Supported on JetPack-4.4+**|
72
-
| Windows / GPU |**Unofficial Support**|
73
-
| Linux ppc64le / GPU | - |
89
+
| Windows / GPU |**Unofficial Support**|
90
+
| Linux ppc64le / GPU | - |
74
91
75
92
> Note: Refer NVIDIA NGC container(https://ngc.nvidia.com/catalog/containers/nvidia:l4t-pytorch) for PyTorch libraries on JetPack.
76
93
77
94
### Dependencies
95
+
78
96
These are the following dependencies used to verify the testcases. Torch-TensorRT can work with other versions, but the tests are not guaranteed to pass.
79
97
80
98
- Bazel 4.0.0
@@ -118,10 +136,11 @@ then you have two options.
118
136
> Make sure when running Torch-TensorRT that these versions of the libraries are prioritized in your `$LD_LIBRARY_PATH`
119
137
120
138
1. You need to download the tarball distributions of TensorRT and cuDNN from the NVIDIA website.
121
-
-https://developer.nvidia.com/cudnn
122
-
-https://developer.nvidia.com/tensorrt
139
+
-https://developer.nvidia.com/cudnn
140
+
-https://developer.nvidia.com/tensorrt
123
141
2. Place these files in a directory (the directories `third_party/dist_dir/[x86_64-linux-gnu | aarch64-linux-gnu]` exist for this purpose)
0 commit comments