Skip to content

Commit 6dcb490

Browse files
docs: update README with the correct Python version
1 parent 8b5a055 commit 6dcb490

File tree

1 file changed

+8
-6
lines changed

1 file changed

+8
-6
lines changed

README.md

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -812,13 +812,13 @@ values for the parameters field. Note that you need to parse this string using
812812
## Managing Python Runtime and Libraries
813813

814814
Python backend shipped in the [NVIDIA GPU Cloud](https://ngc.nvidia.com/)
815-
containers uses Python 3.10. Python backend is able to use the libraries
815+
containers uses Python 3.12. Python backend is able to use the libraries
816816
that exist in the current Python environment. These libraries can
817817
be installed in a virtualenv, conda environment, or the global system
818818
Python. These libraries will only be used if the Python version matches
819819
the Python version of the Python backend's stub executable. For example,
820820
if you install a set of libraries in a Python 3.9 environment and your
821-
Python backend stub is compiled with Python 3.10 these libraries will NOT
821+
Python backend stub is compiled with Python 3.12 these libraries will NOT
822822
be available in your Python model served using Triton. You would need to
823823
compile the stub executable with Python 3.9 using the instructions in
824824
[Building Custom Python Backend Stub](#building-custom-python-backend-stub)
@@ -827,7 +827,7 @@ section.
827827
### Building Custom Python Backend Stub
828828

829829
**Important Note: You only need to compile a custom Python backend stub if the
830-
Python version is different from Python 3.10 which is shipped by
830+
Python version is different from Python 3.12 which is shipped by
831831
default in the Triton containers.**
832832

833833
Python backend uses a *stub* process to connect your `model.py` file to the
@@ -1016,7 +1016,7 @@ In this case you only need to pack your environment using `conda-pack` and
10161016
provide the path to tar file in the model config. However, the previous note
10171017
still applies here and the version of the Python interpreter inside the conda
10181018
environment must match the Python version of stub used by Python backend. The
1019-
default version of the stub is Python 3.10.
1019+
default version of the stub is Python 3.12.
10201020

10211021
3. You can share a single execution environment across multiple models. You
10221022
need to provide the path to the tar file in the `EXECUTION_ENV_PATH` in the
@@ -1039,8 +1039,10 @@ other than Ubuntu 22.04 can lead to unexpected errors.
10391039

10401040
7. If you encounter the "GLIBCXX_3.4.30 not found" error during runtime, we
10411041
recommend upgrading your conda version and installing `libstdcxx-ng=12` by
1042-
running `conda install -c conda-forge libstdcxx-ng=12 -y`. If this solution does
1043-
not resolve the issue, please feel free to open an issue on the
1042+
running `conda install -c conda-forge libstdcxx-ng=12 -y`. Similarly, if you
1043+
encounter the "GLIBCXX_3.4.32 not found" error during runtime, the recommended
1044+
solution is to run `conda install -c conda-forge libstdcxx-ng=13 -y`. If this
1045+
solution does not resolve the issue, please feel free to open an issue on the
10441046
[GitHub issue page](https://github.com/triton-inference-server/server/issues)
10451047
following the provided
10461048
[instructions](https://github.com/triton-inference-server/server#reporting-problems-asking-questions).

0 commit comments

Comments
 (0)