CUDA: Accelerate MXFP4 table lookup using __byte_perm
(#15451)
#11
release.yml
on: push
Matrix: ubuntu-22-cpu
Matrix: windows-cpu
Matrix: windows-cuda
Matrix: windows-hip
Matrix: windows
macOS-arm64
2m 42s
macOS-x64
6m 2s
ubuntu-22-vulkan
7m 32s
windows-sycl
10m 56s
ios-xcode-build
11m 46s
release
1m 36s
Annotations
13 warnings
windows (opencl-adreno, arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/arm64-window...
Cache not found for keys: ccache-windows-latest-cmake-opencl-adreno-arm64-
|
windows-cpu (arm64)
Cache not found for keys: ccache-windows-latest-cmake-cpu-arm64-
|
macOS-arm64
curl 8.15.0 is already installed and up-to-date.
To reinstall 8.15.0, run:
brew reinstall curl
|
macOS-arm64
Cache not found for keys: ccache-macOS-latest-cmake-arm64-
|
ubuntu-22-cpu (x64, ubuntu-22.04)
Cache not found for keys: ccache-ubuntu-cpu-cmake-
|
windows (vulkan, x64, -DGGML_VULKAN=ON, ggml-vulkan)
Cache not found for keys: ccache-windows-latest-cmake-vulkan-x64-
|
windows-cpu (x64)
Cache not found for keys: ccache-windows-latest-cmake-cpu-x64-
|
macOS-x64
curl 8.15.0 is already installed and up-to-date.
To reinstall 8.15.0, run:
brew reinstall curl
|
macOS-x64
Cache not found for keys: ccache-macOS-latest-cmake-x64-
|
ubuntu-22-vulkan
Cache not found for keys: ccache-ubuntu-22-cmake-vulkan-
|
windows-sycl
Cache not found for keys: ccache-windows-latest-cmake-sycl-
|
windows-cuda (12.4)
Cache not found for keys: ccache-windows-cuda-12.4-
|
windows-hip (radeon, gfx1100;gfx1101;gfx1102;gfx1030;gfx1031;gfx1032)
Cache not found for keys: ccache-windows-latest-cmake-hip-radeon-x64-
|
Artifacts
Produced during runtime
Name | Size | Digest | |
---|---|---|---|
cudart-llama-bin-win-cuda-12.4-x64.zip
|
372 MB |
sha256:30fe59f32c14464f8be827f9ce2d2b3e18f398b72193f4a78faa12de8116800d
|
|
llama-b6277-xcframework
|
83.8 MB |
sha256:db259b4cb09d4392ea642caf9d4b3b6b210a942d35e7bf2b7b00048d2b6af625
|
|
llama-bin-macos-arm64.zip
|
10.9 MB |
sha256:e2949ea2b1878ef305caa69bf07387af84611f129f56b2d8868a685bcf950d5e
|
|
llama-bin-macos-x64.zip
|
28 MB |
sha256:8a065b7523b4186f025647800e9648f3292d3dc9b1d4b97a7602b74e2c6f5f6c
|
|
llama-bin-ubuntu-vulkan-x64.zip
|
24.3 MB |
sha256:41bb1d06e487ed4deda76d700f9dc1317de36efb64bbc1d5c750e316d83a041c
|
|
llama-bin-ubuntu-x64.zip
|
12.8 MB |
sha256:f6b143aad32952c05d0f607a8967a0da8a24441ac40da2ad27a4d5d0516182b4
|
|
llama-bin-win-cpu-arm64.zip
|
11.1 MB |
sha256:59f01688f1b3af2b64b3ef0856a4e664bb83775fba1514b1e1f28066703868e2
|
|
llama-bin-win-cpu-x64.zip
|
14 MB |
sha256:9c6e57cfc002b7dda5cbb8ac36fca505cd7b169ea43e7d56a0c274af6ec14d84
|
|
llama-bin-win-cuda-12.4-x64.zip
|
122 MB |
sha256:7fde8711506764c0b453d11cb11b39bfb8a1a43b604bcd74095595bdb2e86e20
|
|
llama-bin-win-hip-radeon-x64.zip
|
264 MB |
sha256:fa2bb54418e53e09805efc67ac65a34552ddbccf65344d9471b4efa40c82d953
|
|
llama-bin-win-opencl-adreno-arm64.zip
|
107 KB |
sha256:138025d4f548184b931c572fa0096065e8b71a19355f1a56517cfb33afe6de0b
|
|
llama-bin-win-sycl-x64.zip
|
80 MB |
sha256:1e4a0d26066ac817e873a4b33aa969fd226659c2323f90cca3f145dd7dac08ac
|
|
llama-bin-win-vulkan-x64.zip
|
10.7 MB |
sha256:532b952694f84c7fb865b819d4b5af090f06e6684930cf2b9b4525d6d5459409
|
|