@@ -812,13 +812,13 @@ values for the parameters field. Note that you need to parse this string using
812
812
## Managing Python Runtime and Libraries
813
813
814
814
Python backend shipped in the [ NVIDIA GPU Cloud] ( https://ngc.nvidia.com/ )
815
- containers uses Python 3.10 . Python backend is able to use the libraries
815
+ containers uses Python 3.12 . Python backend is able to use the libraries
816
816
that exist in the current Python environment. These libraries can
817
817
be installed in a virtualenv, conda environment, or the global system
818
818
Python. These libraries will only be used if the Python version matches
819
819
the Python version of the Python backend's stub executable. For example,
820
820
if you install a set of libraries in a Python 3.9 environment and your
821
- Python backend stub is compiled with Python 3.10 these libraries will NOT
821
+ Python backend stub is compiled with Python 3.12 these libraries will NOT
822
822
be available in your Python model served using Triton. You would need to
823
823
compile the stub executable with Python 3.9 using the instructions in
824
824
[ Building Custom Python Backend Stub] ( #building-custom-python-backend-stub )
@@ -827,7 +827,7 @@ section.
827
827
### Building Custom Python Backend Stub
828
828
829
829
** Important Note: You only need to compile a custom Python backend stub if the
830
- Python version is different from Python 3.10 which is shipped by
830
+ Python version is different from Python 3.12 which is shipped by
831
831
default in the Triton containers.**
832
832
833
833
Python backend uses a * stub* process to connect your ` model.py ` file to the
@@ -1016,7 +1016,7 @@ In this case you only need to pack your environment using `conda-pack` and
1016
1016
provide the path to tar file in the model config. However, the previous note
1017
1017
still applies here and the version of the Python interpreter inside the conda
1018
1018
environment must match the Python version of stub used by Python backend. The
1019
- default version of the stub is Python 3.10 .
1019
+ default version of the stub is Python 3.12 .
1020
1020
1021
1021
3 . You can share a single execution environment across multiple models. You
1022
1022
need to provide the path to the tar file in the ` EXECUTION_ENV_PATH ` in the
@@ -1039,8 +1039,10 @@ other than Ubuntu 22.04 can lead to unexpected errors.
1039
1039
1040
1040
7 . If you encounter the "GLIBCXX_3.4.30 not found" error during runtime, we
1041
1041
recommend upgrading your conda version and installing ` libstdcxx-ng=12 ` by
1042
- running ` conda install -c conda-forge libstdcxx-ng=12 -y ` . If this solution does
1043
- not resolve the issue, please feel free to open an issue on the
1042
+ running ` conda install -c conda-forge libstdcxx-ng=12 -y ` . Similarly, if you
1043
+ encounter the "GLIBCXX_3.4.32 not found" error during runtime, the recommended
1044
+ solution is to run ` conda install -c conda-forge libstdcxx-ng=13 -y ` . If this
1045
+ solution does not resolve the issue, please feel free to open an issue on the
1044
1046
[ GitHub issue page] ( https://github.com/triton-inference-server/server/issues )
1045
1047
following the provided
1046
1048
[ instructions] ( https://github.com/triton-inference-server/server#reporting-problems-asking-questions ) .
0 commit comments