Skip to content

Commit c4b5540

Browse files
authored
Update "cuda-cupy" package (#8377)
1 parent 3e52154 commit c4b5540

File tree

4 files changed

+2
-14
lines changed

4 files changed

+2
-14
lines changed

python/openai/README.md

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -34,13 +34,6 @@
3434
3535
## Pre-requisites
3636

37-
> [!WARNING]
38-
> **CuPy CUDA 13 Compatibility Issue**: The Triton Inference Server Image has been upgraded to CUDA 13. You may encounter issues when using CuPy before it officially supports CUDA 13 (see [this issue](https://github.com/cupy/cupy/issues/9286) requesting CUDA 13 support). Some issues may be resolved by linking CUDA 12 shared objects to CUDA 13, for example:
39-
> ```bash
40-
> ln -sf /usr/local/cuda/targets/x86_64-linux/lib/libnvrtc.so.13.0.48 /usr/local/cuda/targets/x86_64-linux/lib/libnvrtc.so.12
41-
> export LD_LIBRARY_PATH="/usr/local/cuda/targets/x86_64-linux/lib:$LD_LIBRARY_PATH"
42-
> ```
43-
4437
1. Docker + NVIDIA Container Runtime
4538
2. A correctly configured `HF_TOKEN` for access to HuggingFace models.
4639
- The current examples and testing primarily use the

qa/L0_dlpack_multi_gpu/test.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ pip3 uninstall -y torch
4444
pip3 install torch==2.3.1+cu118 -f https://download.pytorch.org/whl/torch_stable.html
4545

4646
# Install CuPy for testing non_blocking compute streams
47-
pip3 install cupy-cuda12x
47+
pip3 install cupy-cuda13x
4848

4949
if [ ${CUDA_VERSION%%.*} -gt 12 ]; then
5050
curl -L https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvrtc/linux-x86_64/cuda_nvrtc-linux-x86_64-12.9.86-archive.tar.xz \

qa/L0_python_api/test.sh

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -27,11 +27,6 @@
2727

2828
pip3 install pytest-asyncio==0.23.8
2929

30-
# Create CUDA compatibility symlink for CuPy
31-
# TODO: Remove patch once CuPy supports CUDA 13
32-
ln -sf /usr/local/cuda/targets/x86_64-linux/lib/libnvrtc.so.13.0.48 /usr/local/cuda/targets/x86_64-linux/lib/libnvrtc.so.12
33-
export LD_LIBRARY_PATH="/usr/local/cuda/targets/x86_64-linux/lib:$LD_LIBRARY_PATH"
34-
3530
RET=0
3631

3732
set +e

src/python/setup.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,7 @@ def get_tag(self):
7171
"_c/triton_bindings.pyi",
7272
]
7373

74-
gpu_extras = ["cupy-cuda12x"]
74+
gpu_extras = ["cupy-cuda13x"]
7575
test_extras = ["pytest"]
7676
all_extras = gpu_extras + test_extras
7777

0 commit comments

Comments
 (0)