VM crashes during installation using https://github.com/Chillee/vllm.git

[shivani405]

Steps that I followed on NVIDIA L4 GPU VM with CUDA 13.0

1. pip install --pre torch torchvision --index-url https://download.pytorch.org/whl/nightly/cu130
2. git clone https://github.com/Chillee/vllm.git
3. cd vllm
4. python use_existing_torch.py
5. pip install uv
6. uv pip install -r requirements/build.txt
7. uv pip install --no-build-isolation -e . -vv

Error log after the crash

[212/469] Building CUDA object
vllm-flash-attn/CMakeFiles/_vllm_fa3_C.dir/hopper/instantiations/flash_fwd_hdim64_512_bf16_softcap_packgqa_sm90.cu.o
[213/469] Building CUDA object
vllm-flash-attn/CMakeFiles/_vllm_fa3_C.dir/hopper/instantiations/flash_fwd_hdim64_512_bf16_split_sm90.cu.o
-- Install configuration: "RelWithDebInfo"

[stderr]
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools_scm/_integration/version_inference.py:51:
UserWarning: version of None already set
warnings.warn(self.message)
CMake Warning at
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:140
(message):
Failed to compute shorthash for libnvrtc.so
Call Stack (most recent call first):
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86
(include)
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68
(find_package)
CMakeLists.txt:80 (find_package)

CMake Warning at
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:323
(message):
pytorch is not compatible with CMAKE_CUDA_ARCHITECTURES and will
ignore
its value. Please configure TORCH_CUDA_ARCH_LIST instead.
Call Stack (most recent call first):
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86
(include)
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68
(find_package)
CMakeLists.txt:80 (find_package)

CMake Warning at
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22
(message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:125
(append_torchlib_if_found)
CMakeLists.txt:80 (find_package)

CMake Warning at CMakeLists.txt:112 (message):
Pytorch version 2.8.0 expected for CUDA build, saw 2.10.0 instead.

CMake Warning (dev) at
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:1564
(cmake_parse_arguments):
The BUILD_COMMAND keyword was followed by an empty string or no value
at
all. Policy CMP0174 is not set, so cmake_parse_arguments() will unset
the
ARG_BUILD_COMMAND variable rather than setting it to an empty string.
Call Stack (most recent call first):
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2145:EVAL:2
(__FetchContent_doPopulation)
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2145
(cmake_language)
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2384
(__FetchContent_Populate)
cmake/external_projects/flashmla.cmake:30 (FetchContent_MakeAvailable)
CMakeLists.txt:942 (include)
This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:1564
(cmake_parse_arguments):
The CONFIGURE_COMMAND keyword was followed by an empty string or no
value
at all. Policy CMP0174 is not set, so cmake_parse_arguments() will
unset
the ARG_CONFIGURE_COMMAND variable rather than setting it to an empty
string.
Call Stack (most recent call first):
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2145:EVAL:2
(__FetchContent_doPopulation)
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2145
(cmake_language)
/home/aladmin/shivani/myvenv_312/lib/python3.12/site-packages/cmake/data/share/cmake-4.1/Modules/FetchContent.cmake:2384
(__FetchContent_Populate)
cmake/external_projects/flashmla.cmake:30 (FetchContent_MakeAvailable)
CMakeLists.txt:942 (include)
This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning at .deps/vllm-flash-attn-src/CMakeLists.txt:75 (message):
Pytorch version 2.4.0 expected for CUDA build, saw 2.10.0 instead.

CMake Error at cmake_install.cmake:98 (file):
file INSTALL cannot find "/tmp/tmpglev4cg9.build-temp/_moe_C.abi3.so":
No
such file or directory.

Traceback (most recent call last):
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 139, in run
self._create_wheel_file(bdist_wheel)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 340, in _create_wheel_file
files, mapping = self._run_build_commands(dist_name, unpacked, lib,
tmp)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 263, in _run_build_commands
self._run_build_subcommands()
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 290, in _run_build_subcommands
self.run_command(name)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/cmd.py",
line 357, in run_command
self.distribution.run_command(command)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/dist.py",
line 1104, in run_command
super().run_command(command)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
line 1021, in run_command
cmd_obj.run()
File "", line 270, in run
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/build_ext.py",
line 99, in run
_build_ext.run(self)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
line 368, in run
self.build_extensions()
File "", line 266, in build_extensions
File "/usr/lib64/python3.12/subprocess.py", line 415, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '--install', '.',
'--prefix', PosixPath('/tmp/tmpx3d7br8t.build-lib'), '--component',
'_moe_C']' returned non-zero exit status 1.
/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/dist.py:1021:
_DebuggingTips: Problem in editable installation.
!!

---

      An error happened while installing `vllm` in editable mode.

      The following steps are recommended to help debug this problem:

      - Try to install the project normally, without using the

editable mode.
Does the error still persist?
(If it does, try fixing the problem before attempting the
editable mode).
- If you are using binary extensions, make sure you have all
OS-level
dependencies installed (e.g. compilers, toolchains, binary
libraries, ...).
- Try the latest version of setuptools (maybe the error was
already fixed).
- If you (or your project dependencies) are using any setuptools
extension
or customization, make sure they support the editable mode.

      After following the steps above, if the problem still persists

and
you think this is related to how setuptools handles editable
installations,
please submit a reproducible example
(see https://stackoverflow.com/help/minimal-reproducible-example)
to:

          https://github.com/pypa/setuptools/issues

      See

https://setuptools.pypa.io/en/latest/userguide/development_mode.html
for details.

---

!!
cmd_obj.run()
Traceback (most recent call last):
File "", line 11, in
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/build_meta.py",
line 476, in build_editable
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/build_meta.py",
line 407, in _build_with_temp_dir
self.run_setup()
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/build_meta.py",
line 320, in run_setup
exec(code, locals())
File "", line 650, in
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/init.py",
line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/core.py",
line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/core.py",
line 202, in run_commands
dist.run_commands()
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
line 1002, in run_commands
self.run_command(cmd)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/dist.py",
line 1104, in run_command
super().run_command(command)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
line 1021, in run_command
cmd_obj.run()
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 139, in run
self._create_wheel_file(bdist_wheel)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 340, in _create_wheel_file
files, mapping = self._run_build_commands(dist_name, unpacked, lib,
tmp)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 263, in _run_build_commands
self._run_build_subcommands()
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/editable_wheel.py",
line 290, in _run_build_subcommands
self.run_command(name)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/cmd.py",
line 357, in run_command
self.distribution.run_command(command)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/dist.py",
line 1104, in run_command
super().run_command(command)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
line 1021, in run_command
cmd_obj.run()
File "", line 270, in run
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/command/build_ext.py",
line 99, in run
_build_ext.run(self)
File
"/home/aladmin/shivani/myvenv_312/lib64/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
line 368, in run
self.build_extensions()
File "", line 266, in build_extensions
File "/usr/lib64/python3.12/subprocess.py", line 415, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '--install', '.',
'--prefix', PosixPath('/tmp/tmpx3d7br8t.build-lib'), '--component',
'_moe_C']' returned non-zero exit status 1.

hint: This usually indicates a problem with the package or the build
environment.

[shivani405]

Any update?