what am I doing wrong ? libmpi_cxx.so.40: cannot open shared object file: No such file or directory #34090
Description
Your current environment
installed uv , because I normally use pip and pipx .
uv init vllm
cd vllm
uv venv --python 3.12 --seed
( Using CPython 3.12.12
Creating virtual environment with seed packages at: .venv )
source .venv/bin/activate
(vllm) root@ave:/vllm# uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm//vllm# vllm
( Resolved 182 packages in 5.71s
Installed 182 packages in 125ms )
vllm) root@ave:
Traceback (most recent call last):
File "/root/vllm/.venv/bin/vllm", line 4, in
from vllm.entrypoints.cli.main import main
File "/root/vllm/.venv/lib/python3.12/site-packages/vllm/init.py", line 14, in
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/vllm/.venv/lib/python3.12/site-packages/vllm/env_override.py", line 5, in
import torch
File "/root/vllm/.venv/lib/python3.12/site-packages/torch/init.py", line 426, in
_load_global_deps()
File "/root/vllm/.venv/lib/python3.12/site-packages/torch/init.py", line 379, in _load_global_deps
raise err
File "/root/vllm/.venv/lib/python3.12/site-packages/torch/init.py", line 334, in _load_global_deps
ctypes.CDLL(global_deps_lib_path, mode=ctypes.RTLD_GLOBAL)
File "/root/.local/share/uv/python/cpython-3.12.12-linux-x86_64-gnu/lib/python3.12/ctypes/init.py", line 379, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libmpi_cxx.so.40: cannot open shared object file: No such file or directory
How would you like to use vllm
I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.