Skip to content

musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc #12611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
Mar 30, 2025
Merged

musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc #12611

merged 6 commits into from
Mar 30, 2025

Conversation

@yeahdongcn
Copy link
Collaborator

@yeahdongcn yeahdongcn commented Mar 27, 2025 •
edited
Loading

Make sure to read the contributing guidelines before submitting a PR

This PR resolves all compilation warnings and re-enables -DLLAMA_FATAL_WARNINGS=ON in run.sh for MUSA.

Testing Done

  • CI: gg_run_ctest_debug and gg_run_ctest_release
  • ./build/bin/llama-cli -m ~/models/deepseek-r1_7b_q4_0.gguf -ngl 999

Logs:

+ gg_run_ctest_debug
+ cd /ws
+ rm -rf build-ci-debug
+ tee /ci-results/ctest_debug.log
+ mkdir build-ci-debug
+ cd build-ci-debug
+ set -e
+ gg_check_build_requirements
+ command -v cmake
+ command -v make
+ command -v ctest
+ tee -a /ci-results/ctest_debug-cmake.log
+ cmake -DCMAKE_BUILD_TYPE=Debug -DLLAMA_FATAL_WARNINGS=ON -DGGML_MUSA=ON -DMUSA_ARCHITECTURES=21 ..
-- The C compiler identification is GNU 11.4.0
-- The CXX compiler identification is GNU 11.4.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found Git: /usr/bin/git (found version "2.34.1") 
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE  
-- ccache found, compilation results will be cached. Disable with GGML_CCACHE=OFF.
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- Including CPU backend
-- Found OpenMP_C: -fopenmp (found version "4.5") 
-- Found OpenMP_CXX: -fopenmp (found version "4.5") 
-- Found OpenMP: TRUE (found version "4.5")  
-- x86 detected
-- Adding CPU backend variant ggml-cpu: -march=native 
-- Found MUSAToolkit: /usr/local/musa/include  
-- MUSA Toolkit found
-- Using MUSA architectures: 21
-- Including MUSA backend
-- Configuring done
-- Generating done
-- Build files have been written to: /ws/build-ci-debug

real    0m0.872s
user    0m0.670s
sys     0m0.195s
+ tee -a /ci-results/ctest_debug-make.log
++ nproc
+ make -j12
[  0%] Building C object examples/gguf-hash/CMakeFiles/sha1.dir/deps/sha1/sha1.c.o
[  0%] Building C object examples/gguf-hash/CMakeFiles/sha256.dir/deps/sha256/sha256.c.o
[  0%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
[  0%] Building CXX object common/CMakeFiles/build_info.dir/build-info.cpp.o
[  1%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o
[  1%] Building C object examples/gguf-hash/CMakeFiles/xxhash.dir/deps/xxhash/xxhash.c.o
[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-opt.cpp.o
[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o
[  2%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o
[  3%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o
[  3%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o
[  3%] Built target sha256
[  3%] Built target sha1
[  3%] Built target xxhash
[  3%] Linking CXX shared library ../../bin/libggml-base.so
[  3%] Built target build_info
[  3%] Built target ggml-base
[  4%] Building C object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.c.o
[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-hbm.cpp.o
[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.cpp.o
[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o
[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-quants.c.o
[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-traits.cpp.o
[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/amx.cpp.o
[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o
[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/llamafile/sgemm.cpp.o
[  6%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/arange.cu.o
[  6%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/acc.cu.o
[  7%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/argmax.cu.o
[  7%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/argsort.cu.o
[  8%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/binbcast.cu.o
[  8%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/clamp.cu.o
[  8%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/concat.cu.o
[  8%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/conv-transpose-1d.cu.o
[  9%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/convert.cu.o
[  9%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/cpy.cu.o
[  9%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/count-equal.cu.o
[ 10%] Linking CXX shared library ../../bin/libggml-cpu.so
[ 10%] Built target ggml-cpu
[ 11%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/cross-entropy-loss.cu.o
[ 11%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/diagmask.cu.o
[ 11%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/fattn-tile-f16.cu.o
[ 12%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/fattn-tile-f32.cu.o
[ 12%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/fattn-wmma-f16.cu.o
[ 12%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/fattn.cu.o
[ 13%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/getrows.cu.o
[ 13%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/ggml-cuda.cu.o
[ 13%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/gla.cu.o
[ 14%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/im2col.cu.o
[ 14%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/mmq.cu.o
[ 14%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/mmv.cu.o
[ 15%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/mmvq.cu.o
[ 15%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/norm.cu.o
[ 15%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/opt-step-adamw.cu.o
[ 16%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/out-prod.cu.o
[ 16%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/pad.cu.o
[ 16%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/pool2d.cu.o
[ 17%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/quantize.cu.o
[ 17%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/rope.cu.o
[ 17%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/scale.cu.o
[ 18%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/softmax.cu.o
[ 18%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/sum.cu.o
[ 18%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/sumrows.cu.o
[ 19%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/tsembd.cu.o
[ 19%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/unary.cu.o
[ 19%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/upscale.cu.o
[ 20%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/wkv.cu.o
[ 20%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_8.cu.o
[ 21%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_1.cu.o
[ 21%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_2.cu.o
[ 21%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_4.cu.o
[ 22%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_4.cu.o
[ 22%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_8.cu.o
[ 22%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_1.cu.o
[ 23%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_2.cu.o
[ 23%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_2.cu.o
[ 23%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_4.cu.o
[ 24%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_8.cu.o
[ 24%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_64-ncols2_1.cu.o
[ 24%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_1.cu.o
[ 25%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_2.cu.o
[ 25%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_4.cu.o
[ 25%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_8.cu.o
[ 26%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq1_s.cu.o
[ 26%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq2_s.cu.o
[ 26%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq2_xs.cu.o
[ 27%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq2_xxs.cu.o
[ 27%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq3_s.cu.o
[ 27%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq3_xxs.cu.o
[ 28%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq4_nl.cu.o
[ 28%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-iq4_xs.cu.o
[ 28%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q2_k.cu.o
[ 29%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q3_k.cu.o
[ 29%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q4_0.cu.o
[ 29%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q4_1.cu.o
[ 30%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q4_k.cu.o
[ 30%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q5_0.cu.o
[ 30%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q5_1.cu.o
[ 31%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q5_k.cu.o
[ 31%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q6_k.cu.o
[ 31%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/mmq-instance-q8_0.cu.o
[ 32%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q4_0.cu.o
[ 32%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f32-instance-hs128-q4_0-q4_0.cu.o
[ 32%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q8_0-q8_0.cu.o
[ 33%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f32-instance-hs128-q8_0-q8_0.cu.o
[ 33%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-f16.cu.o
[ 33%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f16-instance-hs256-f16-f16.cu.o
[ 34%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f16-instance-hs64-f16-f16.cu.o
[ 34%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f32-instance-hs128-f16-f16.cu.o
[ 34%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f32-instance-hs256-f16-f16.cu.o
[ 35%] Building CXX object ggml/src/ggml-musa/CMakeFiles/ggml-musa.dir/__/ggml-cuda/template-instances/fattn-vec-f32-instance-hs64-f16-f16.cu.o
[ 35%] Linking CXX shared library ../../../bin/libggml-musa.so
[ 35%] Built target ggml-musa
[ 35%] Building CXX object ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o
[ 36%] Linking CXX shared library ../../bin/libggml.so
[ 36%] Built target ggml
[ 36%] Building CXX object src/CMakeFiles/llama.dir/llama.cpp.o
[ 36%] Building CXX object examples/gguf/CMakeFiles/llama-gguf.dir/gguf.cpp.o
[ 37%] Building CXX object examples/gguf-hash/CMakeFiles/llama-gguf-hash.dir/gguf-hash.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/llama-adapter.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/llama-batch.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/llama-arch.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/llama-chat.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/llama-context.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/llama-grammar.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/llama-graph.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/llama-hparams.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/llama-impl.cpp.o
[ 40%] Linking CXX executable ../../bin/llama-gguf
[ 40%] Linking CXX executable ../../bin/llama-gguf-hash
[ 40%] Building CXX object src/CMakeFiles/llama.dir/llama-kv-cache.cpp.o
[ 41%] Building CXX object src/CMakeFiles/llama.dir/llama-io.cpp.o
[ 41%] Building CXX object src/CMakeFiles/llama.dir/llama-memory.cpp.o
[ 41%] Building CXX object src/CMakeFiles/llama.dir/llama-model-loader.cpp.o
[ 42%] Building CXX object src/CMakeFiles/llama.dir/llama-mmap.cpp.o
[ 42%] Building CXX object src/CMakeFiles/llama.dir/llama-model.cpp.o
[ 43%] Building CXX object src/CMakeFiles/llama.dir/llama-quant.cpp.o
[ 43%] Building CXX object src/CMakeFiles/llama.dir/llama-sampling.cpp.o
[ 43%] Building CXX object src/CMakeFiles/llama.dir/llama-vocab.cpp.o
[ 44%] Building CXX object src/CMakeFiles/llama.dir/unicode-data.cpp.o
[ 44%] Building CXX object src/CMakeFiles/llama.dir/unicode.cpp.o
[ 44%] Linking CXX shared library ../bin/libllama.so
[ 44%] Built target llama-gguf-hash
[ 44%] Built target llama-gguf
[ 44%] Built target llama
[ 45%] Building CXX object common/CMakeFiles/common.dir/arg.cpp.o
[ 46%] Building C object tests/CMakeFiles/test-c.dir/test-c.c.o
[ 46%] Building CXX object common/CMakeFiles/common.dir/chat.cpp.o
[ 47%] Building CXX object examples/simple/CMakeFiles/llama-simple.dir/simple.cpp.o
[ 48%] Building CXX object examples/quantize-stats/CMakeFiles/llama-quantize-stats.dir/quantize-stats.cpp.o
[ 48%] Building CXX object common/CMakeFiles/common.dir/common.cpp.o
[ 49%] Building CXX object common/CMakeFiles/common.dir/console.cpp.o
[ 49%] Building CXX object common/CMakeFiles/common.dir/llguidance.cpp.o
[ 50%] Building CXX object examples/llava/CMakeFiles/llava.dir/llava.cpp.o
[ 51%] Building CXX object common/CMakeFiles/common.dir/log.cpp.o
[ 51%] Building CXX object examples/simple-chat/CMakeFiles/llama-simple-chat.dir/simple-chat.cpp.o
[ 51%] Building CXX object common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o
[ 51%] Linking C executable ../bin/test-c
[ 51%] Linking CXX executable ../../bin/llama-simple
[ 52%] Linking CXX executable ../../bin/llama-simple-chat
[ 52%] Building CXX object common/CMakeFiles/common.dir/ngram-cache.cpp.o
[ 52%] Building CXX object examples/llava/CMakeFiles/llava.dir/clip.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/sampling.cpp.o
[ 52%] Linking CXX executable ../../bin/llama-quantize-stats
[ 53%] Building CXX object common/CMakeFiles/common.dir/speculative.cpp.o
[ 53%] Built target llava
[ 53%] Linking CXX static library libcommon.a
[ 53%] Built target test-c
[ 53%] Linking CXX shared library ../../bin/libllava_shared.so
[ 54%] Linking CXX static library libllava_static.a
[ 54%] Built target llava_static
[ 54%] Built target llama-quantize-stats
[ 54%] Built target llama-simple
[ 54%] Built target llama-simple-chat
[ 54%] Built target llava_shared
[ 54%] Built target common
[ 54%] Building CXX object tests/CMakeFiles/test-sampling.dir/test-sampling.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-tokenizer-0.dir/test-tokenizer-0.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-llama-grammar.dir/test-llama-grammar.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-sampling.dir/get-model.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-grammar-parser.dir/test-grammar-parser.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-grammar-integration.dir/test-grammar-integration.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-chat.dir/test-chat.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-json-schema-to-grammar.dir/test-json-schema-to-grammar.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-tokenizer-1-bpe.dir/test-tokenizer-1-bpe.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-log.dir/test-log.cpp.o
[ 56%] Building CXX object tests/CMakeFiles/test-tokenizer-1-spm.dir/test-tokenizer-1-spm.cpp.o
[ 57%] Building CXX object tests/CMakeFiles/test-arg-parser.dir/test-arg-parser.cpp.o
[ 58%] Building CXX object tests/CMakeFiles/test-grammar-integration.dir/get-model.cpp.o
[ 58%] Linking CXX executable ../bin/test-sampling
[ 59%] Linking CXX executable ../bin/test-tokenizer-0
[ 60%] Building CXX object tests/CMakeFiles/test-llama-grammar.dir/get-model.cpp.o
[ 61%] Building CXX object tests/CMakeFiles/test-log.dir/get-model.cpp.o
[ 61%] Linking CXX executable ../bin/test-tokenizer-1-bpe
[ 61%] Linking CXX executable ../bin/test-tokenizer-1-spm
[ 62%] Building CXX object tests/CMakeFiles/test-grammar-parser.dir/get-model.cpp.o
[ 62%] Linking CXX executable ../bin/test-grammar-integration
[ 62%] Linking CXX executable ../bin/test-llama-grammar
[ 63%] Linking CXX executable ../bin/test-grammar-parser
[ 63%] Building CXX object tests/CMakeFiles/test-json-schema-to-grammar.dir/get-model.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-chat.dir/get-model.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-arg-parser.dir/get-model.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-chat-template.dir/test-chat-template.cpp.o
[ 64%] Linking CXX executable ../bin/test-log
[ 64%] Linking CXX executable ../bin/test-chat
[ 64%] Linking CXX executable ../bin/test-json-schema-to-grammar
[ 64%] Linking CXX executable ../bin/test-arg-parser
[ 65%] Building CXX object tests/CMakeFiles/test-chat-template.dir/get-model.cpp.o
[ 65%] Linking CXX executable ../bin/test-chat-template
[ 65%] Built target test-log
[ 65%] Built target test-sampling
[ 65%] Building CXX object tests/CMakeFiles/test-gguf.dir/test-gguf.cpp.o
[ 65%] Built target test-llama-grammar
[ 66%] Building CXX object tests/CMakeFiles/test-gguf.dir/get-model.cpp.o
[ 67%] Building CXX object tests/CMakeFiles/test-backend-ops.dir/test-backend-ops.cpp.o
[ 67%] Built target test-grammar-parser
[ 67%] Building CXX object tests/CMakeFiles/test-model-load-cancel.dir/test-model-load-cancel.cpp.o
[ 67%] Linking CXX executable ../bin/test-gguf
[ 68%] Building CXX object tests/CMakeFiles/test-autorelease.dir/test-autorelease.cpp.o
[ 69%] Building CXX object tests/CMakeFiles/test-model-load-cancel.dir/get-model.cpp.o
[ 69%] Building CXX object tests/CMakeFiles/test-autorelease.dir/get-model.cpp.o
[ 69%] Building CXX object tests/CMakeFiles/test-backend-ops.dir/get-model.cpp.o
[ 69%] Linking CXX executable ../bin/test-model-load-cancel
[ 69%] Linking CXX executable ../bin/test-autorelease
[ 69%] Linking CXX executable ../bin/test-backend-ops
[ 69%] Built target test-tokenizer-1-spm
[ 69%] Built target test-tokenizer-1-bpe
[ 70%] Building CXX object tests/CMakeFiles/test-barrier.dir/test-barrier.cpp.o
[ 70%] Built target test-tokenizer-0
[ 70%] Building CXX object tests/CMakeFiles/test-quantize-fns.dir/test-quantize-fns.cpp.o
[ 70%] Building CXX object tests/CMakeFiles/test-barrier.dir/get-model.cpp.o
[ 70%] Linking CXX executable ../bin/test-barrier
[ 71%] Building CXX object tests/CMakeFiles/test-quantize-fns.dir/get-model.cpp.o
[ 71%] Building CXX object tests/CMakeFiles/test-quantize-perf.dir/test-quantize-perf.cpp.o
[ 71%] Linking CXX executable ../bin/test-quantize-fns
[ 72%] Building CXX object tests/CMakeFiles/test-quantize-perf.dir/get-model.cpp.o
[ 72%] Linking CXX executable ../bin/test-quantize-perf
[ 72%] Built target test-gguf
[ 72%] Built target test-grammar-integration
[ 72%] Building CXX object examples/batched-bench/CMakeFiles/llama-batched-bench.dir/batched-bench.cpp.o
[ 72%] Building CXX object tests/CMakeFiles/test-rope.dir/test-rope.cpp.o
[ 72%] Built target test-barrier
[ 73%] Building CXX object tests/CMakeFiles/test-rope.dir/get-model.cpp.o
[ 74%] Linking CXX executable ../../bin/llama-batched-bench
[ 74%] Built target test-model-load-cancel
[ 74%] Built target test-json-schema-to-grammar
[ 74%] Linking CXX executable ../bin/test-rope
[ 75%] Building CXX object examples/batched/CMakeFiles/llama-batched.dir/batched.cpp.o
[ 75%] Building CXX object examples/embedding/CMakeFiles/llama-embedding.dir/embedding.cpp.o
[ 75%] Built target test-autorelease
[ 76%] Building CXX object examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o
[ 76%] Linking CXX executable ../../bin/llama-batched
[ 76%] Linking CXX executable ../../bin/llama-embedding
[ 76%] Building CXX object examples/gbnf-validator/CMakeFiles/llama-gbnf-validator.dir/gbnf-validator.cpp.o
[ 76%] Linking CXX executable ../../bin/llama-eval-callback
[ 76%] Built target test-backend-ops
[ 76%] Linking CXX executable ../../bin/llama-gbnf-validator
[ 76%] Building CXX object examples/gguf-split/CMakeFiles/llama-gguf-split.dir/gguf-split.cpp.o
[ 76%] Built target test-quantize-fns
[ 77%] Linking CXX executable ../../bin/llama-gguf-split
[ 77%] Built target test-rope
[ 77%] Building CXX object examples/gritlm/CMakeFiles/llama-gritlm.dir/gritlm.cpp.o
[ 77%] Built target test-quantize-perf
[ 77%] Linking CXX executable ../../bin/llama-gritlm
[ 78%] Building CXX object examples/imatrix/CMakeFiles/llama-imatrix.dir/imatrix.cpp.o
[ 78%] Building CXX object examples/infill/CMakeFiles/llama-infill.dir/infill.cpp.o
[ 79%] Linking CXX executable ../../bin/llama-infill
[ 79%] Linking CXX executable ../../bin/llama-imatrix
[ 79%] Built target llama-gguf-split
[ 79%] Built target llama-gbnf-validator
[ 79%] Building CXX object examples/llama-bench/CMakeFiles/llama-bench.dir/llama-bench.cpp.o
[ 79%] Built target test-chat
[ 79%] Building CXX object examples/lookahead/CMakeFiles/llama-lookahead.dir/lookahead.cpp.o
[ 79%] Linking CXX executable ../../bin/llama-bench
[ 79%] Built target test-chat-template
[ 80%] Linking CXX executable ../../bin/llama-lookahead
[ 80%] Built target test-arg-parser
[ 80%] Building CXX object examples/lookup/CMakeFiles/llama-lookup.dir/lookup.cpp.o
[ 81%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-create.dir/lookup-create.cpp.o
[ 81%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-merge.dir/lookup-merge.cpp.o
[ 81%] Linking CXX executable ../../bin/llama-lookup
[ 81%] Linking CXX executable ../../bin/llama-lookup-create
[ 82%] Linking CXX executable ../../bin/llama-lookup-merge
[ 82%] Built target llama-lookup-merge
[ 82%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-stats.dir/lookup-stats.cpp.o
[ 82%] Built target llama-bench
[ 82%] Linking CXX executable ../../bin/llama-lookup-stats
[ 83%] Building CXX object examples/main/CMakeFiles/llama-cli.dir/main.cpp.o
[ 83%] Built target llama-batched-bench
[ 83%] Linking CXX executable ../../bin/llama-cli
[ 83%] Building CXX object examples/parallel/CMakeFiles/llama-parallel.dir/parallel.cpp.o
[ 83%] Built target llama-eval-callback
[ 83%] Built target llama-embedding
[ 84%] Linking CXX executable ../../bin/llama-parallel
[ 84%] Building CXX object examples/passkey/CMakeFiles/llama-passkey.dir/passkey.cpp.o
[ 85%] Building CXX object examples/perplexity/CMakeFiles/llama-perplexity.dir/perplexity.cpp.o
[ 85%] Linking CXX executable ../../bin/llama-passkey
[ 85%] Built target llama-batched
[ 85%] Linking CXX executable ../../bin/llama-perplexity
[ 85%] Building CXX object examples/quantize/CMakeFiles/llama-quantize.dir/quantize.cpp.o
[ 85%] Built target llama-gritlm
[ 85%] Linking CXX executable ../../bin/llama-quantize
[ 85%] Built target llama-infill
[ 85%] Building CXX object examples/retrieval/CMakeFiles/llama-retrieval.dir/retrieval.cpp.o
[ 86%] Generating loading.html.hpp
[ 86%] Linking CXX executable ../../bin/llama-retrieval
[ 86%] Built target llama-imatrix
[ 86%] Generating index.html.gz.hpp
[ 87%] Building CXX object examples/save-load-state/CMakeFiles/llama-save-load-state.dir/save-load-state.cpp.o
[ 87%] Built target llama-lookahead
[ 87%] Linking CXX executable ../../bin/llama-save-load-state
[ 87%] Built target llama-lookup-create
[ 88%] Building CXX object examples/run/CMakeFiles/llama-run.dir/run.cpp.o
[ 88%] Built target llama-lookup
[ 88%] Building CXX object examples/run/CMakeFiles/llama-run.dir/linenoise.cpp/linenoise.cpp.o
[ 88%] Building CXX object examples/speculative/CMakeFiles/llama-speculative.dir/speculative.cpp.o
[ 88%] Building CXX object examples/speculative-simple/CMakeFiles/llama-speculative-simple.dir/speculative-simple.cpp.o
[ 88%] Linking CXX executable ../../bin/llama-run
[ 88%] Linking CXX executable ../../bin/llama-speculative-simple
[ 89%] Linking CXX executable ../../bin/llama-speculative
[ 89%] Built target llama-quantize
[ 90%] Building CXX object examples/tokenize/CMakeFiles/llama-tokenize.dir/tokenize.cpp.o
[ 90%] Linking CXX executable ../../bin/llama-tokenize
[ 90%] Built target llama-cli
[ 90%] Built target llama-lookup-stats
[ 90%] Building CXX object examples/tts/CMakeFiles/llama-tts.dir/tts.cpp.o
[ 90%] Built target llama-parallel
[ 90%] Building CXX object examples/gen-docs/CMakeFiles/llama-gen-docs.dir/gen-docs.cpp.o
[ 91%] Building CXX object examples/convert-llama2c-to-ggml/CMakeFiles/llama-convert-llama2c-to-ggml.dir/convert-llama2c-to-ggml.cpp.o
[ 92%] Linking CXX executable ../../bin/llama-gen-docs
[ 92%] Linking CXX executable ../../bin/llama-convert-llama2c-to-ggml
[ 93%] Linking CXX executable ../../bin/llama-tts
[ 93%] Built target llama-perplexity
[ 93%] Building CXX object examples/cvector-generator/CMakeFiles/llama-cvector-generator.dir/cvector-generator.cpp.o
[ 93%] Built target llama-passkey
[ 94%] Linking CXX executable ../../bin/llama-cvector-generator
[ 94%] Building CXX object examples/export-lora/CMakeFiles/llama-export-lora.dir/export-lora.cpp.o
[ 95%] Linking CXX executable ../../bin/llama-export-lora
[ 95%] Built target llama-tokenize
[ 95%] Built target llama-retrieval
[ 95%] Built target llama-run
[ 95%] Building CXX object examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o
[ 95%] Building CXX object examples/llava/CMakeFiles/llama-qwen2vl-cli.dir/qwen2vl-cli.cpp.o
[ 95%] Built target llama-save-load-state
[ 96%] Building CXX object examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o
[ 97%] Linking CXX executable ../../bin/llama-qwen2vl-cli
[ 97%] Linking CXX executable ../../bin/llama-llava-cli
[ 97%] Linking CXX executable ../../bin/llama-minicpmv-cli
[ 98%] Building CXX object examples/llava/CMakeFiles/llama-gemma3-cli.dir/gemma3-cli.cpp.o
[ 98%] Built target llama-convert-llama2c-to-ggml
[ 98%] Linking CXX executable ../../bin/llama-gemma3-cli
[ 99%] Building CXX object examples/llava/CMakeFiles/llama-llava-clip-quantize-cli.dir/clip-quantize-cli.cpp.o
[ 99%] Linking CXX executable ../../bin/llama-llava-clip-quantize-cli
[ 99%] Built target llama-speculative
[ 99%] Built target llama-speculative-simple
[ 99%] Building CXX object pocs/vdot/CMakeFiles/llama-vdot.dir/vdot.cpp.o
[ 99%] Building CXX object pocs/vdot/CMakeFiles/llama-q8dot.dir/q8dot.cpp.o
[ 99%] Linking CXX executable ../../bin/llama-vdot
[100%] Linking CXX executable ../../bin/llama-q8dot
[100%] Building CXX object examples/server/CMakeFiles/llama-server.dir/server.cpp.o
[100%] Built target llama-q8dot
[100%] Built target llama-vdot
[100%] Built target llama-llava-clip-quantize-cli
[100%] Linking CXX executable ../../bin/llama-server
[100%] Built target llama-gen-docs
[100%] Built target llama-cvector-generator
[100%] Built target llama-tts
[100%] Built target llama-export-lora
[100%] Built target llama-minicpmv-cli
[100%] Built target llama-gemma3-cli
[100%] Built target llama-llava-cli
[100%] Built target llama-qwen2vl-cli
[100%] Built target llama-server

real    0m56.158s
user    8m52.327s
sys     0m19.406s

@github-actions github-actions bot added Nvidia GPU Issues specific to Nvidia GPUs devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning labels Mar 27, 2025
@yeahdongcn
Copy link
Collaborator Author

yeahdongcn commented Mar 27, 2025

Noted that the Windows tests are failing; I'll work on fixing them tomorrow.

@yeahdongcn
fix Windows build issue
4add034 
Signed-off-by: Xiaodong Ye <[email protected]>
@yeahdongcn
Copy link
Collaborator Author

yeahdongcn commented Mar 28, 2025

The CI has been passed. Hi @ggerganov @JohannesGaessler, please review when you have time. Thanks.

ggerganov
ggerganov reviewed Mar 28, 2025
View reviewed changes
JohannesGaessler
JohannesGaessler reviewed Mar 28, 2025
View reviewed changes
@yeahdongcn
Address review comments
f7886ec 
Signed-off-by: Xiaodong Ye <[email protected]>
@yeahdongcn
Address review comments
5dc84ce 
Signed-off-by: Xiaodong Ye <[email protected]>
@JohannesGaessler JohannesGaessler merged commit 492d7f1 into ggml-org:master Mar 30, 2025
48 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ggerganov ggerganov ggerganov left review comments

@JohannesGaessler JohannesGaessler JohannesGaessler approved these changes

Assignees

No one assigned

Labels

devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@yeahdongcn @ggerganov @JohannesGaessler