昇腾910B：libruntime.so: undefined symbol: _ZN12ErrorManager19ATCReportErrMessageESsRKSt6vectorISsSaISsEES4_

[sduqlsc]

描述问题

python -c "import paddle; paddle.utils.run_check()"
I1120 14:24:04.506531  1920 init.cc:238] ENV [CUSTOM_DEVICE_ROOT]=/usr/local/lib/python3.10/dist-packages/paddle_custom_device
I1120 14:24:04.506573  1920 init.cc:146] Try loading custom device libs from: [/usr/local/lib/python3.10/dist-packages/paddle_custom_device]
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/local/lib/python3.10/dist-packages/paddle/__init__.py", line 38, in <module>
    from .base import core  # noqa: F401
  File "/usr/local/lib/python3.10/dist-packages/paddle/base/__init__.py", line 205, in <module>
    __bootstrap__()
  File "/usr/local/lib/python3.10/dist-packages/paddle/base/__init__.py", line 197, in __bootstrap__
    core.init_devices()
ValueError: (InvalidArgument) Fail to open library: /usr/local/lib/python3.10/dist-packages/paddle_custom_device/libpaddle-custom-npu.so with error: /usr/local/Ascend/ascend-toolkit/8.0.RC3.alpha003/aarch64-linux/lib64/libruntime.so: undefined symbol: _ZN12ErrorManager19ATCReportErrMessageESsRKSt6vectorISsSaISsEES4_
  [Hint: dso_handle should not be null.] (at /paddle/paddle/fluid/platform/init.cc:153)

复现

FROM ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-npu:cann800-ubuntu20-npu-910b-base-aarch64-gcc84

RUN apt.....

RUN --mount=type=cache,target=/var/cache/pip \
    python -m pip install --no-cache-dir --upgrade pip wheel setuptools && \
    python -m pip install --no-cache-dir paddlepaddle==3.0.0.dev20250430 -i https://www.paddlepaddle.org.cn/packages/nightly/cpu && \
    python -m pip install --no-cache-dir paddle-custom-npu -i https://www.paddlepaddle.org.cn/packages/nightly/npu && \
    python -m pip install --no-cache-dir https://paddle-model-ecology.bj.bcebos.com/paddlex/whl/paddlenlp-device/tool_helpers-0.1.1-cp310-cp310-linux_aarch64.whl && \
    python -m pip install --no-cache-dir numpy==1.26.4 && \
    python -m pip install --no-cache-dir opencv-python==3.4.18.65 && \
    pip install --no-cache-dir "paddlex[base]" && \
    pip list

RUN paddlex --install serving
# RUN paddlex --install PaddleClas PaddleOCR PaddleDetection PaddleSeg --platform gitee.com

COPY ./paddlex_home /app/.paddlex
# RUN paddlex --serve --pipeline OCR

ENTRYPOINT ["/usr/bin/tini", "--"]
EXPOSE 8080
CMD ["bash"]

    devices:
      - /dev/davinci_manager:/dev/davinci_manager
      - /dev/hisi_hdc:/dev/hisi_hdc
      - /dev/devmm_svm:/dev/devmm_svm
      - /dev/davinci1:/dev/davinci1
    volumes:
      - ./app:/app
      - /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro
      - /usr/local/bin/npu-smi:/usr/local/bin/npu-smi
      - /usr/local/dcmi:/usr/local/dcmi
      - /usr/local/Ascend/ascend-toolkit:/usr/local/Ascend/ascend-toolkit
      - /etc/ascend_install.info:/etc/ascend_install.info

docker exec -it ppocrv5 bash
source /usr/local/Ascend/ascend-toolkit/set_env.sh
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkit/8.0.RC3.alpha003/aarch64-linux/devlib/linux/aarch64/:/usr/local/Ascend/ascend-toolkit/8.0.RC3.alpha003/aarch64-linux/lib64/:/usr/local/Ascend/nnal/atb/8.0.0/atb/cxx_abi_0/lib/:/usr/local/Ascend/nnal/atb/8.0.0/atb/cxx_abi_1/
export LD_PRELOAD=/usr/lib/aarch64-linux-gnu/libgomp.so.1
python -c "import paddle; paddle.utils.run_check()"

环境

1. 请提供您使用的PaddlePaddle、PaddleX版本号、Python版本号
   Python 3.10.16
   paddle-custom-npu 3.0.0.dev20251119
   paddle2onnx 1.3.1
   paddlepaddle 3.0.0.dev20250430
   paddlex 3.3.9

2. 请提供您使用的操作系统信息，如Linux/Windows/MacOS
   麒麟V10 Arm64

3. 请问您使用的CUDA/cuDNN的版本号是？
   npu-smi 24.1.0 Version: 24.1.0
   ascend-toolkit 8.0.RC3.alpha003