[Bug]: 部署模型时编译失败 #506
Description
Your environment
(xllm) [root@localhost xllm]# python setup.py build
/usr/local/lib64/python3.11/site-packages/torch/cuda/init.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
import pynvml # type: ignore[import]
🚀 Build xllm with CPU arch: arm and target device: a2
🔍 Checking repo status: /root/xllm/third_party/Mooncake
git reset --hard for /root/xllm/third_party/Mooncake
🛠️ Apply patch: ../custom_patch/Mooncake.patch
🎉 Success apply patch!
🔍 Checking repo status: /root/xllm/third_party/cpprestsdk
git reset --hard for /root/xllm/third_party/cpprestsdk
🛠️ Apply patch: ../custom_patch/cpprestsdk.patch
🎉 Success apply patch!
pre-commit installed at .git/hooks/pre-commit
/usr/local/lib/python3.11/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: Apache Software License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
running build
running build_py
creating build/lib.linux-aarch64-cpython-311/xllm
copying xllm/launch_xllm.py -> build/lib.linux-aarch64-cpython-311/xllm
copying xllm/init.py -> build/lib.linux-aarch64-cpython-311/xllm
creating build/lib.linux-aarch64-cpython-311/xllm/pybind
copying xllm/pybind/llm.py -> build/lib.linux-aarch64-cpython-311/xllm/pybind
copying xllm/pybind/vlm.py -> build/lib.linux-aarch64-cpython-311/xllm/pybind
copying xllm/pybind/embedding.py -> build/lib.linux-aarch64-cpython-311/xllm/pybind
copying xllm/pybind/util.py -> build/lib.linux-aarch64-cpython-311/xllm/pybind
copying xllm/pybind/args.py -> build/lib.linux-aarch64-cpython-311/xllm/pybind
running build_ext
CMake Args: ['-G', 'Ninja', '-DCMAKE_MAKE_PROGRAM=/usr/bin/ninja', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/root/xllm/build/lib.linux-aarch64-cpython-311/xllm', '-DCMAKE_RUNTIME_OUTPUT_DIRECTORY=/root/xllm/build/lib.linux-aarch64-cpython-311/xllm', '-DUSE_CCACHE=ON', '-DUSE_MANYLINUX:BOOL=ON', '-DPython_EXECUTABLE:FILEPATH=/root/miniforge3/envs/xllm/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DBUILD_SHARED_LIBS=OFF', '-DDEVICE_TYPE=USE_A2', '-DDEVICE_ARCH=ARM', '-DINSTALL_XLLM_KERNELS=ON', '-DUSE_NPU=ON', '-DGENERATE_SO=OFF', '-DUSE_CXX11_ABI=OFF']
Env: {'ATB_OPSRUNNER_KERNEL_CACHE_TILING_SIZE': '10240', 'NVM_INC': '/root/.nvm/versions/node/v24.11.1/include/node', 'ASDOPS_HOME_PATH': '/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False', 'ASDOPS_LOG_PATH': '', 'CONDA_EXE': '/root/miniforge3/bin/conda', '_CE_M': '', 'MINDIE_LOG_TO_FILE': '1', 'HOSTNAME': 'localhost.localdomain', 'ATB_OPSRUNNER_KERNEL_CACHE_LOCAL_COUNT': '1', 'PYTHON_VERSION': '3.11.6', 'ATB_STREAM_SYNC_EVERY_RUNNER_ENABLE': '0', 'VCPKG_FORCE_SYSTEM_BINARIES': '1', 'ASDOPS_TILING_PARSE_CACHE_DISABLE': '0', 'MINDIE_LOG_TO_STDOUT': '0', 'ATB_OPSRUNNER_SETUP_CACHE_ENABLE': '1', 'XML_CATALOG_FILES': 'file:///root/miniforge3/etc/xml/catalog file:///etc/xml/catalog', 'ASCENDIE_HOME': '/usr/local/Ascend/mindie/latest/mindie-rt', 'PWD': '/root/xllm', 'ATB_WORKSPACE_MEM_ALLOC_GLOBAL': '0', 'VCPKG_ROOT': '/vcpkg-src', 'CONDA_PREFIX': '/root/miniforge3/envs/xllm', 'ATB_DEVICE_TILING_BUFFER_BLOCK_NUM': '32', 'ATB_STREAM_SYNC_EVERY_KERNEL_ENABLE': '0', 'TZ': 'Asia/Shanghai', 'ATB_OPSRUNNER_KERNEL_CACHE_GLOABL_COUNT': '5', 'HCCL_CONNECT_TIMEOUT': '7200', 'HOME': '/root', 'PYTORCH_NPU_ALLOC_CONF': 'expandable_segments:True', 'ATB_LOG_TO_FILE_FLUSH': '0', 'ASCEND_NNAE_HOME': '/usr/local/Ascend/nnae/latest', 'LS_COLORS': 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=00:tw=30;42:ow=34;42:st=37;44:ex=01;32:.tar=01;31:.tgz=01;31:.arc=01;31:.arj=01;31:.taz=01;31:.lha=01;31:.lz4=01;31:.lzh=01;31:.lzma=01;31:.tlz=01;31:.txz=01;31:.tzo=01;31:.t7z=01;31:.zip=01;31:.z=01;31:.dz=01;31:.gz=01;31:.lrz=01;31:.lz=01;31:.lzo=01;31:.xz=01;31:.zst=01;31:.tzst=01;31:.bz2=01;31:.bz=01;31:.tbz=01;31:.tbz2=01;31:.tz=01;31:.deb=01;31:.rpm=01;31:.jar=01;31:.war=01;31:.ear=01;31:.sar=01;31:.rar=01;31:.alz=01;31:.ace=01;31:.zoo=01;31:.cpio=01;31:.7z=01;31:.rz=01;31:.cab=01;31:.wim=01;31:.swm=01;31:.dwm=01;31:.esd=01;31:.avif=01;35:.jpg=01;35:.jpeg=01;35:.mjpg=01;35:.mjpeg=01;35:.gif=01;35:.bmp=01;35:.pbm=01;35:.pgm=01;35:.ppm=01;35:.tga=01;35:.xbm=01;35:.xpm=01;35:.tif=01;35:.tiff=01;35:.png=01;35:.svg=01;35:.svgz=01;35:.mng=01;35:.pcx=01;35:.mov=01;35:.mpg=01;35:.mpeg=01;35:.m2v=01;35:.mkv=01;35:.webm=01;35:.webp=01;35:.ogm=01;35:.mp4=01;35:.m4v=01;35:.mp4v=01;35:.vob=01;35:.qt=01;35:.nuv=01;35:.wmv=01;35:.asf=01;35:.rm=01;35:.rmvb=01;35:.flc=01;35:.avi=01;35:.fli=01;35:.flv=01;35:.gl=01;35:.dl=01;35:.xcf=01;35:.xwd=01;35:.yuv=01;35:.cgm=01;35:.emf=01;35:.ogv=01;35:.ogx=01;35:.aac=00;36:.au=00;36:.flac=00;36:.m4a=00;36:.mid=00;36:.midi=00;36:.mka=00;36:.mp3=00;36:.mpc=00;36:.ogg=00;36:.ra=00;36:.wav=00;36:.oga=00;36:.opus=00;36:.spx=00;36:.xspf=00;36:=00;90:#=00;90:.bak=00;90:.crdownload=00;90:.dpkg-dist=00;90:.dpkg-new=00;90:.dpkg-old=00;90:.dpkg-tmp=00;90:.old=00;90:.orig=00;90:.part=00;90:.rej=00;90:.rpmnew=00;90:.rpmorig=00;90:.rpmsave=00;90:.swp=00;90:.tmp=00;90:.ucf-dist=00;90:.ucf-new=00;90:*.ucf-old=00;90:', 'CARGO_HOME': '/root/.cargo', 'HCCL_BUFFSIZE': '120', 'MIES_INSTALL_PATH': '/usr/local/Ascend/mindie/latest/mindie-service', 'ATB_HOME_PATH': '/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0', 'CONDA_PROMPT_MODIFIER': '(xllm) ', 'ASCEND_SLOG_PRINT_TO_STDOUT': '0', 'ASCEND_GLOBAL_EVENT_ENABLE': '0', 'PYTHON_MAJOR_VERSION': '3.11', 'https_proxy': '', 'PYTHON_SHORT_VERSION': '311', 'ATB_CONTEXT_HOSTTILING_RING': '1', 'HCCL_EXEC_TIMEOUT': '0', 'ATB_OPERATION_EXECUTE_ASYNC': '1', 'TOOLCHAIN_HOME': '/usr/local/Ascend/ascend-toolkit/latest/toolkit', 'ASCEND_TOOLKIT_HOME': '/usr/local/Ascend/ascend-toolkit/latest', 'ASDOPS_LOG_TO_FILE': '1', 'ATB_CONTEXT_HOSTTILING_SIZE': '102400', 'NVM_DIR': '/root/.nvm', '_CONDA_EXE': '/root/miniforge3/bin/conda', '_CONDA_ROOT': '/root/miniforge3', 'PYTHONPATH': '/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:/usr/local/Ascend/nnae/latest/python/site-packages:/usr/local/Ascend/nnae/latest/opp/built-in/op_impl/ai_core/tbe:/usr/local/Ascend/nnrt/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:/usr/local/Ascend/atb-models:/usr/local/Ascend/mindie/latest/mindie-llm:/usr/local/Ascend/mindie/latest/mindie-llm/lib:/usr/local/Ascend/mindie/latest/mindie-service/bin:/usr/local/lib/python3.11/site-packages:/usr/local/lib64/python3.11/site-packages:/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:', 'ASCEND_GLOBAL_LOG_LEVEL': '3', 'TERM': 'xterm', 'ASDOPS_LOG_LEVEL': 'ERROR', 'CE_CONDA': '', 'LCCL_DETERMINISTIC': '0', 'ASCEND_CUSTOM_OPP_PATH': '/usr/local/Ascend/mindie/latest/mindie-rt/ops/vendors/aie_ascendc:/usr/local/Ascend/mindie/latest/mindie-rt/ops/vendors/customize:', 'ASDOPS_MATMUL_PP_FLAG': '1', 'MINDIE_LLM_HOME_PATH': '/usr/local/Ascend/mindie/latest/mindie-llm', 'TASK_QUEUE_ENABLE': '1', 'CONDA_SHLVL': '2', 'SHLVL': '1', 'NVM_CD_FLAGS': '', 'TUNE_BANK_PATH': '/usr/local/Ascend/mindie/latest/mindie-rt/aoe', 'PYTORCH_INSTALL_PATH': '/usr/local/lib64/python3.11/site-packages/torch', 'PYTORCH_NPU_INSTALL_PATH': '/usr/local/libtorch_npu/', 'ASDOPS_LOG_TO_BOOST_TYPE': 'atb', 'ASDOPS_LOG_TO_FILE_FLUSH': '0', 'http_proxy': '', 'ATB_SPEED_HOME_PATH': '/usr/local/Ascend/atb-models', 'ATB_COMPARE_TILING_EVERY_KERNEL': '0', 'ASCEND_OPP_PATH': '/usr/local/Ascend/ascend-toolkit/latest/opp', 'CONDA_PYTHON_EXE': '/root/miniforge3/bin/python', 'MINDIE_LLM_RECOMPUTE_THRESHOLD': '0.5', 'LD_LIBRARY_PATH': '/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/nnae/latest/lib64:/usr/local/Ascend/nnae/latest/lib64/plugin/opskernel:/usr/local/Ascend/nnae/latest/lib64/plugin/nnengine:/usr/local/Ascend/driver/lib64:/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:/usr/local/Ascend/nnrt/latest/lib64:/usr/local/Ascend/driver/lib64:/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64:/usr/local/libtorch_npu/lib:/usr/lib64:/lib:/lib:/usr/local/Ascend/atb-models/lib:/usr/local/Ascend/mindie/latest/mindie-llm/lib:/usr/local/Ascend/mindie/latest/mindie-llm/lib/grpc:/usr/local/Ascend/mindie/latest/mindie-service/lib:/usr/local/Ascend/mindie/latest/mindie-service/lib/grpc:/usr/local/Ascend/mindie/latest/mindie-torch/lib:/usr/local/Ascend/mindie/latest/mindie-rt/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/driver/lib64/driver:/usr/local/Ascend/driver/lib64/common::/usr/local/lib64/python3.11/site-packages/torch.libs:/usr/local/dcmi:/usr/local/Ascend/driver/lib64:/usr/local/Ascend/driver/lib64/driver', 'ASCEND_AICPU_PATH': '/usr/local/Ascend/ascend-toolkit/latest', 'CONDA_DEFAULT_ENV': 'xllm', 'VCPKG_OVERLAY_TRIPLETS': '/vcpkg-src/triplets/community', 'OMP_NUM_THREADS': '12', 'MINDIE_TORCH_HOME': '/usr/local/Ascend/mindie/latest/mindie-torch', 'ATB_OPSRUNNER_KERNEL_CACHE_TYPE': '3', 'MINDIE_LLM_CONTINUOUS_BATCHING': '1', 'ASCEND_NNRT_HOME': '/usr/local/Ascend/nnrt/latest', 'NPU_MEMORY_FRACTION': '0.98', 'ATB_RUNNER_POOL_SIZE': '64', 'ATB_STREAM_SYNC_EVERY_OPERATION_ENABLE': '0', 'PATH': '/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/root/.nvm/versions/node/v24.11.1/bin:/root/miniforge3/envs/xllm/bin:/root/miniforge3/condabin:/usr/local/Ascend/nnae/latest/bin:/usr/local/Ascend/nnae/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/root/.cargo/bin:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/Ascend/toolbox/latest/Ascend-DMI/bin', 'ASCEND_HOME_PATH': '/usr/local/Ascend/nnae/latest', 'ATB_USE_TILING_COPY_STREAM': '0', 'NVM_BIN': '/root/.nvm/versions/node/v24.11.1/bin', 'CONDA_PREFIX_1': '/root/miniforge3', 'ASDOPS_LOG_TO_STDOUT': '0', 'ATB_MATMUL_SHUFFLE_K_ENABLE': '1', 'ATB_LAUNCH_KERNEL_WITH_TILING': '1', 'ATB_WORKSPACE_MEM_ALLOC_ALG_TYPE': '1', 'OLDPWD': '/root/xllm/third_party', 'ATB_HOST_TILING_BUFFER_BLOCK_NUM': '128', 'ATB_SHARE_MEMORY_NAME_SUFFIX': '', '': '/root/miniforge3/envs/xllm/bin/python', 'LC_CTYPE': 'C.UTF-8', 'PLAT': 'linux-aarch64', 'XLLM_KERNELS_PATH': '/usr/local/xllm_kernels', 'PYTHON_INCLUDE_PATH': '/root/miniforge3/envs/xllm/include/python3.11', 'PYTHON_LIB_PATH': '/usr/local/lib64/python3.11/site-packages/torch', 'LIBTORCH_ROOT': '/usr/local/lib64/python3.11/site-packages/torch', 'INSTALL_XLLM_KERNELS': 'ON', 'NPU_TOOLKIT_HOME': '/usr/local/Ascend/ascend-toolkit/latest', 'NPU_HOME_PATH': '/usr/local/Ascend/ascend-toolkit/latest', 'ATB_PATH': '/usr/local/Ascend/nnal/atb', 'LCCL_PARALLEL': '0'}
-- Building for device: A2 (macro USE_A2 defined)
-- INSTALL_XLLM_KERNELS enabled: ON
downloading a2 arm xllm_kernels
Verifying... ########################################
Preparing... ########################################
Updating / installing...
xllm_kernels-1.3.4-1 ########################################
-- xllm_ops git HEAD changed; running precompile via execute_process
which: no ccache in (/usr/local/Ascend/nnae/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/nnae/latest/compiler/bin:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_False/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/root/.nvm/versions/node/v24.11.1/bin:/root/miniforge3/envs/xllm/bin:/root/miniforge3/condabin:/usr/local/Ascend/nnae/latest/bin:/usr/local/Ascend/nnae/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/root/.cargo/bin:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/Ascend/toolbox/latest/Ascend-DMI/bin)
[2025-12-09 13:47:35] Info: cmake config -DBUILD_OPEN_PROJECT=ON -DCUSTOM_ASCEND_CANN_PACKAGE_PATH=/usr/local/Ascend/nnae/latest -DCHECK_COMPATIBLE=false .
-DCMAKE_BUILD_TYPE=Release -DENABLE_SOURCE_PACKAGE=True -DENABLE_BINARY_PACKAGE=True -DASCEND_COMPUTE_UNIT=ascend910_93;ascend910b; -DENABLE_TEST=True -Dvendor_name=xllm -DASCEND_CANN_PACKAGE_PATH=/usr/local/Ascend/ascend-toolkit/latest -DASCEND_PYTHON_EXECUTABLE=python3 -DCMAKE_INSTALL_PREFIX=/root/xllm/third_party/xllm_ops/build -DENABLE_CROSS_COMPILE=False -DCMAKE_CROSS_PLATFORM_COMPILER=/usr/bin/aarch64-linux-gnu-g++
-- The C compiler identification is GNU 12.3.1
-- The CXX compiler identification is GNU 12.3.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found Python3: /root/miniforge3/envs/xllm/bin/python3.11 (found version "3.11.0") found components: Interpreter
-- ASCEND_CANN_PACKAGE_PATH=/usr/local/Ascend/nnae/latest
-- ENABLE_CCACHE=ON, CUSTOM_CCACHE=
-- CCACHE_PROGRAM=CCACHE_PROGRAM-NOTFOUND
-- ASCEND_COMPUTE_UNIT=ascend910_93;ascend910b;
-- ASCEND_OP_NAME=ALL
-- TILING_KEY=
-- TESTS_UT_OPS_TEST=
-- TESTS_EXAMPLE_OPS_TEST=
CMake Warning:
Manually-specified variables were not used by the project:
OPS_COMPILE_OPTIONS
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/metadef: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
/root/xllm/third_party/xllm_ops/xllm_ops/apply_top_k_top_p_with_sorted/apply_top_k_top_p_with_sorted_cpu.cpp:21:10: fatal error: register/op_def_registry.h: No such file or directory
21 | #include "register/op_def_registry.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from /root/xllm/third_party/xllm_ops/xllm_ops/beam_search/beam_search_cpu.cpp:16:
/root/xllm/third_party/xllm_ops/xllm_ops/beam_search/beam_search_tiling.h:16:10: fatal error: register/tilingdata_base.h: No such file or directory
16 | #include "register/tilingdata_base.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [CMakeFiles/op_host_aclnnInner.dir/build.make:76: CMakeFiles/op_host_aclnnInner.dir/xllm_ops/apply_top_k_top_p_with_sorted/apply_top_k_top_p_with_sorted_cpu.cpp.o] Error 1
/root/xllm/third_party/xllm_ops/xllm_ops/multi_latent_attention/multi_latent_attention_cpu.cpp:16:10: fatal error: register/op_def_registry.h: No such file or directory
16 | #include "register/op_def_registry.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /root/xllm/third_party/xllm_ops/xllm_ops/index_group_matmul/index_group_matmul_cpu.cpp:16:
/root/xllm/third_party/xllm_ops/xllm_ops/index_group_matmul/index_group_matmul_tiling.h:16:10: fatal error: register/tilingdata_base.h: No such file or directory
16 | #include "register/tilingdata_base.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
compilation terminated.
make[2]: *** [CMakeFiles/Makefile2:291: CMakeFiles/op_host_aclnnInner.dir/all] Error 2
make[2]: *** Waiting for unfinished jobs....
In file included from /root/xllm/third_party/xllm_ops/xllm_ops/pp_matmul_opt/pp_matmul_opt_cpu.cpp:16:
/root/xllm/third_party/xllm_ops/xllm_ops/pp_matmul_opt/pp_matmul_opt_tiling.h:16:10: fatal error: register/tilingdata_base.h: No such file or directory
16 | #include "register/tilingdata_base.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
/root/xllm/third_party/xllm_ops/xllm_ops/moe_fused_add_topk/moe_fused_add_topk_cpu.cpp:1:10: fatal error: register/op_def_registry.h: No such file or directory
1 | #include "register/op_def_registry.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/external: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/platform: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/runtime: No such file or directory [-Wmissing-include-dirs]
cc1plus: warning: /usr/local/Ascend/nnae/latest/include/experiment/msprof: No such file or directory [-Wmissing-include-dirs]
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:76: CMakeFiles/op_host_aclnn.dir/xllm_ops/beam_search/beam_search_cpu.cpp.o] Error 1
make[3]: *** Waiting for unfinished jobs....
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:118: CMakeFiles/op_host_aclnn.dir/xllm_ops/multi_latent_attention/multi_latent_attention_cpu.cpp.o] Error 1
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:90: CMakeFiles/op_host_aclnn.dir/xllm_ops/index_group_matmul/index_group_matmul_cpu.cpp.o] Error 1
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:146: CMakeFiles/op_host_aclnn.dir/xllm_ops/pp_matmul_opt/pp_matmul_opt_cpu.cpp.o] Error 1
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:104: CMakeFiles/op_host_aclnn.dir/xllm_ops/moe_fused_add_topk/moe_fused_add_topk_cpu.cpp.o] Error 1
/root/xllm/third_party/xllm_ops/xllm_ops/pp_mat_mul/pp_mat_mul_cpu.cpp:22:10: fatal error: register/op_def_registry.h: No such file or directory
22 | #include "register/op_def_registry.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
/root/xllm/third_party/xllm_ops/xllm_ops/replace_token/replace_token_cpu.cpp:16:10: fatal error: register/op_def_registry.h: No such file or directory
16 | #include "register/op_def_registry.h"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:132: CMakeFiles/op_host_aclnn.dir/xllm_ops/pp_mat_mul/pp_mat_mul_cpu.cpp.o] Error 1
make[3]: *** [CMakeFiles/op_host_aclnn.dir/build.make:160: CMakeFiles/op_host_aclnn.dir/xllm_ops/replace_token/replace_token_cpu.cpp.o] Error 1
make[2]: *** [CMakeFiles/Makefile2:265: CMakeFiles/op_host_aclnn.dir/all] Error 2
make[1]: *** [CMakeFiles/Makefile2:592: CMakeFiles/prepare_build.dir/rule] Error 2
make: *** [Makefile:345: prepare_build] Error 2
-- result---lmx ------ : 2
-- hello xllm----------------
CMake Error at cmake/config.cmake:232 (message):
Error: ops prepare build failed.
Call Stack (most recent call first):
CMakeLists.txt:21 (include)
-- Configuring incomplete, errors occurred!
CMake Error at CMakeLists.txt:72 (message):
Failed to precompile xllm ops, error code: 1
-- Configuring incomplete, errors occurred!
ERROR: Build failed.
Details: Command '['cmake', '/root/xllm', '-G', 'Ninja', '-DCMAKE_MAKE_PROGRAM=/usr/bin/ninja', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/root/xllm/build/lib.linux-aarch64-cpython-311/xllm', '-DCMAKE_RUNTIME_OUTPUT_DIRECTORY=/root/xllm/build/lib.linux-aarch64-cpython-311/xllm', '-DUSE_CCACHE=ON', '-DUSE_MANYLINUX:BOOL=ON', '-DPython_EXECUTABLE:FILEPATH=/root/miniforge3/envs/xllm/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DBUILD_SHARED_LIBS=OFF', '-DDEVICE_TYPE=USE_A2', '-DDEVICE_ARCH=ARM', '-DINSTALL_XLLM_KERNELS=ON', '-DUSE_NPU=ON', '-DGENERATE_SO=OFF', '-DUSE_CXX11_ABI=OFF']' returned non-zero exit status 1.
🐛 Describe the bug
模型部署时编译失败
是否有直接使用xllm命令行或者其他不需要编译的方式