Compile bug: Cann x86_64 not building

[ericcurtin]

Git commit

[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/llamafile/sgemm.cpp.o
/llama.cpp/ggml/src/ggml-cann/aclnn_ops.cpp: In function 'void ggml_cann_get_rows(ggml_backend_cann_context&, ggml_tensor*)':
/llama.cpp/ggml/src/ggml-cann/aclnn_ops.cpp:1786:49: error: 'float16_t' was not declared in this scope; did you mean 'float_t'?
 1786 |                 src0->data, ACL_FLOAT16, sizeof(float16_t), scale_ne, scale_nb,
      |                                                 ^~~~~~~~~
      |                                                 float_t
gmake[2]: *** [ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/build.make:90: ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/aclnn_ops.cpp.o] Error 1
gmake[2]: *** Waiting for unfinished jobs....
gmake[1]: *** [CMakeFiles/Makefile2:1790: ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
[ 13%] Linking CXX shared library ../../bin/libggml-cpu.so
[ 13%] Built target ggml-cpu
gmake: *** [Makefile:146: all] Error 2
Error: building at STEP "RUN build_llama_and_whisper.sh "cann"": while running runtime: exit status 2
make: *** [Makefile:89: build] Error 2

Operating systems

Linux

GGML backends

Vulkan

Problem description & steps to reproduce

Building cann on x86_64

First Bad Commit

No response

Compile command

"-DGGML_CANN=ON" "-DSOC_TYPE=Ascend910B3"

Relevant log output

[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/llamafile/sgemm.cpp.o
/llama.cpp/ggml/src/ggml-cann/aclnn_ops.cpp: In function 'void ggml_cann_get_rows(ggml_backend_cann_context&, ggml_tensor*)':
/llama.cpp/ggml/src/ggml-cann/aclnn_ops.cpp:1786:49: error: 'float16_t' was not declared in this scope; did you mean 'float_t'?
 1786 |                 src0->data, ACL_FLOAT16, sizeof(float16_t), scale_ne, scale_nb,
      |                                                 ^~~~~~~~~
      |                                                 float_t
gmake[2]: *** [ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/build.make:90: ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/aclnn_ops.cpp.o] Error 1
gmake[2]: *** Waiting for unfinished jobs....
gmake[1]: *** [CMakeFiles/Makefile2:1790: ggml/src/ggml-cann/CMakeFiles/ggml-cann.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
[ 13%] Linking CXX shared library ../../bin/libggml-cpu.so
[ 13%] Built target ggml-cpu
gmake: *** [Makefile:146: all] Error 2
Error: building at STEP "RUN build_llama_and_whisper.sh "cann"": while running runtime: exit status 2
make: *** [Makefile:89: build] Error 2

[ericcurtin]

@leo-pony would it be possible to start a build for cann, x86_64 in llama.cpp upstream? It will be hard to continue building in RamaLama if the build breaks regularly

[hipudding]

#12875 will fix this problem.
There is a build check in llama.cpp upstream, However, due to issues with the EulerOS software source, several PRs were unable to pass this job check in the past few days, which led to this problem being introduced.

This issue is related to the GCC version. It indeed occurs with lower versions of GCC. We’ve already fixed the build CI to prevent such build errors from happening.

We will also add CI support for x86_64 as soon as possible. #12950

[leo-pony]

@leo-pony would it be possible to start a build for cann, x86_64 in llama.cpp upstream? It will be hard to continue building in RamaLama if the build breaks regularly

@ericcurtin #12875 has merged, after merged i tested on x86 and arm platform, all is Okay.
Next, I will update the reference in ramallama to the above commit, and test building.