Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
372 commits
Select commit Hold shift + click to select a range
9128fc4
Merge branch 'ikawrakow:main' into main
Thireus Jul 15, 2025
8c2a6ee
Fix C2131: expression did not evaluate
Thireus Jul 15, 2025
1b097c7
Merge branch 'ikawrakow:main' into main
Thireus Jul 15, 2025
aa0aa02
Update build.yml
Thireus Jul 16, 2025
a60805a
Update ggml.h
Thireus Jul 16, 2025
edaba8e
Merge branch 'ikawrakow:main' into main
Thireus Jul 16, 2025
09d7fac
Update release.yml
Thireus Jul 17, 2025
a47f31f
Revert changes
Thireus Jul 17, 2025
4fbac8e
Update CMakeLists.txt
Thireus Jul 17, 2025
5b1b204
Update CMakeLists.txt
Thireus Jul 17, 2025
699dc2e
Update ggml.h
Thireus Jul 17, 2025
4c81b88
Update llama.cpp
Thireus Jul 17, 2025
118dd3e
Update CMakeLists.txt
Thireus Jul 17, 2025
5237653
Update CMakeLists.txt
Thireus Jul 17, 2025
2b7eaa0
Update CMakeLists.txt
Thireus Jul 17, 2025
27125b1
Update llama.cpp
Thireus Jul 17, 2025
378986d
Merge branch 'ikawrakow:main' into main
Thireus Jul 17, 2025
b407232
Merge branch 'ikawrakow:main' into main
Thireus Jul 18, 2025
ca20df1
Merge branch 'ikawrakow:main' into main
Thireus Jul 20, 2025
87fd730
Merge branch 'ikawrakow:main' into main
Thireus Jul 20, 2025
c90e8a1
Merge branch 'ikawrakow:main' into main
Thireus Jul 22, 2025
758a987
Merge branch 'ikawrakow:main' into main
Thireus Jul 22, 2025
607e01e
Merge branch 'ikawrakow:main' into main
Thireus Jul 23, 2025
642c2b0
Merge branch 'ikawrakow:main' into main
Thireus Jul 23, 2025
efab478
Merge branch 'ikawrakow:main' into main
Thireus Jul 24, 2025
bb4c917
Merge branch 'ikawrakow:main' into main
Thireus Jul 27, 2025
2e53b96
Update convert_hf_to_gguf.py
Thireus Jul 29, 2025
89ebd61
Update constants.py
Thireus Jul 29, 2025
f619be7
Update llama.cpp
Thireus Jul 29, 2025
662283f
Update llama.cpp
Thireus Jul 29, 2025
0c41931
Update llama.cpp
Thireus Jul 29, 2025
56f5b23
Update llama.cpp
Thireus Jul 29, 2025
8dc1c03
Update llama.cpp
Thireus Jul 29, 2025
92b3a36
Update llama.cpp
Thireus Jul 29, 2025
3012914
Update llama.cpp
Thireus Jul 29, 2025
3e252ff
Update llama.cpp
Thireus Jul 29, 2025
7a53691
Update llama.cpp
Thireus Jul 29, 2025
a855c75
Update llama.cpp
Thireus Jul 29, 2025
6882e83
Update llama.cpp
Thireus Jul 29, 2025
32026e8
Update llama.cpp
Thireus Jul 29, 2025
57d272d
Update llama.cpp
Thireus Jul 29, 2025
aacba11
Update llama.cpp
Thireus Jul 29, 2025
59b8b88
Update llama.cpp
Thireus Jul 29, 2025
299c23a
Update llama.cpp
Thireus Jul 29, 2025
019ff22
Update llama.cpp
Thireus Jul 29, 2025
fba5973
Update llama.cpp
Thireus Jul 29, 2025
d28c8a4
Update llama.cpp
Thireus Jul 29, 2025
ff0c368
Update llama.cpp
Thireus Jul 29, 2025
6258a12
Update llama.cpp
Thireus Jul 29, 2025
9b1fdff
Revert "Update llama.cpp"
Thireus Jul 29, 2025
746b87f
Update llama.cpp
Thireus Jul 29, 2025
9ce87a2
Update llama.cpp
Thireus Jul 29, 2025
92f5b07
Update llama.cpp
Thireus Jul 29, 2025
500b273
Update llama.cpp
Thireus Jul 29, 2025
18f9c5b
Revert "Update llama.cpp"
Thireus Jul 29, 2025
4cabc50
Update convert_hf_to_gguf.py
Thireus Jul 29, 2025
e06c5db
Update convert_hf_to_gguf.py
Thireus Jul 29, 2025
36431e7
Update llama.cpp
Thireus Jul 30, 2025
b173be3
Update llama.cpp
Thireus Jul 30, 2025
19bb885
Testing different MoE FFN
Thireus Jul 30, 2025
e941116
Update llama.cpp
Thireus Jul 30, 2025
f5a5a0d
Update llama.cpp
Thireus Jul 30, 2025
6f4eec8
Update llama.cpp
Thireus Jul 30, 2025
a953198
Update llama.cpp
Thireus Jul 30, 2025
660b0b9
Update llama.cpp
Thireus Jul 31, 2025
7e60282
Update convert_hf_to_gguf.py
Thireus Jul 31, 2025
a1a7b3e
Update llama.cpp
Thireus Jul 31, 2025
97d87c7
Update convert_hf_to_gguf.py
Thireus Jul 31, 2025
807cdcb
Update convert_hf_to_gguf.py
Thireus Jul 31, 2025
6979607
Update llama.cpp
Thireus Jul 31, 2025
ef92e5c
Update llama.cpp
Thireus Jul 31, 2025
74dadf3
Update llama.cpp
Thireus Jul 31, 2025
83d2bb3
Update llama.cpp - KQ_mask
Thireus Jul 31, 2025
4250fb4
Update llama.cpp
Thireus Jul 31, 2025
0040a42
Revert "Update llama.cpp"
Thireus Aug 1, 2025
9640fe9
Update llama.cpp - Fix non-fa ppl
Thireus Aug 1, 2025
c74d161
GLM-4.5
Thireus Aug 1, 2025
4e93d34
GLM-4.5
Thireus Aug 1, 2025
a253f2f
GLM-4.5
Thireus Aug 1, 2025
ba74150
Update convert_hf_to_gguf.py - ik_llama bugfix
Thireus Aug 2, 2025
3c06890
convert_hf_to_gguf.py compatibility bugfix with GLM-4.5
Thireus Aug 2, 2025
a6c22f0
Update convert_hf_to_gguf.py
Thireus Aug 2, 2025
08f30c9
Update convert_hf_to_gguf.py
Thireus Aug 2, 2025
d3d3fe6
Add ubergarm comments + my own
Thireus Aug 2, 2025
4e10857
Revert to proper version that produced good BF16
Thireus Aug 3, 2025
fe552b9
Support for jinja chat_template files
Thireus Aug 3, 2025
0a4cb10
Revert to llama.cpp script version that produced good BF16
Thireus Aug 3, 2025
292300d
Support for jinja chat templates
Thireus Aug 3, 2025
c2d602b
Merge pull request #11 from Thireus/glm-4.5
Thireus Aug 4, 2025
a90aec1
GLM-4.5 llama.cpp final port
Thireus Aug 4, 2025
d10c3c6
Updated GLM-4.5 for cross-compatibility with llama.cpp
Thireus Aug 4, 2025
71995c0
Merge pull request #13 from Thireus/glm-4.5-testing
Thireus Aug 5, 2025
f5e913a
Merge pull request #12 from Thireus/glm-4.5
Thireus Aug 5, 2025
25e40ca
Handle TENSOR_SKIP
Thireus Aug 5, 2025
3f3e384
Handle TENSOR_SKIP
Thireus Aug 5, 2025
a3641e6
Bugfix for TENSOR_SKIP
Thireus Aug 5, 2025
46c3fa9
Merge pull request #14 from Thireus/glm-4.5-testing
Thireus Aug 5, 2025
6d2d06e
Merge from GLM-4.5-testing
Thireus Aug 5, 2025
fb08cdf
Merge pull request #16 from Thireus/glm-4.5-testing
Thireus Aug 5, 2025
fca1387
Merge pull request #17 from Thireus/glm-4.5
Thireus Aug 5, 2025
eed86de
Update llama.cpp
Thireus Aug 5, 2025
d97ebef
Update llama.cpp
Thireus Aug 5, 2025
41a235b
Fix chat template detection
Thireus Aug 5, 2025
cae058f
Merge pull request #18 from Thireus/glm-4.5-testing
Thireus Aug 5, 2025
9b4139b
Merge pull request #19 from Thireus/glm-4.5-clean
Thireus Aug 5, 2025
63284c2
Merge pull request #20 from Thireus/glm-4.5
Thireus Aug 5, 2025
323e7f3
Revert to original GGML_ASSERT
Thireus Aug 5, 2025
3ae4504
Merge pull request #21 from Thireus/glm-4.5-testing
Thireus Aug 5, 2025
7665fb5
Whitespace...
Thireus Aug 5, 2025
0675f41
Merge pull request #22 from Thireus/glm-4.5-clean
Thireus Aug 5, 2025
146fdc6
Merge pull request #24 from Thireus/glm-4.5
Thireus Aug 5, 2025
4e5adfd
Junk file
Thireus Aug 5, 2025
a09bed8
Merge branch 'ikawrakow:main' into main
Thireus Aug 8, 2025
cd0d7f0
Merge branch 'ikawrakow:main' into main
Thireus Aug 9, 2025
3e26732
Merge branch 'ikawrakow:main' into main
Thireus Aug 11, 2025
62ef02e
-DGGML_CUDA_USE_GRAPHS=ON
Thireus Aug 11, 2025
a4b669b
Merge branch 'ikawrakow:main' into main
Thireus Aug 13, 2025
b23e0e0
Merge branch 'ikawrakow:main' into main
Thireus Aug 15, 2025
f2c7d78
Merge branch 'ikawrakow:main' into main
Thireus Aug 16, 2025
b99690c
Merge branch 'ikawrakow:main' into main
Thireus Aug 17, 2025
d163a59
Merge branch 'ikawrakow:main' into main
Thireus Aug 17, 2025
b89d295
Merge branch 'ikawrakow:main' into main
Thireus Aug 17, 2025
6908b72
Merge branch 'ikawrakow:main' into main
Thireus Aug 17, 2025
0a4c111
Merge branch 'ikawrakow:main' into main
Thireus Aug 18, 2025
144abc3
Merge branch 'ikawrakow:main' into main
Thireus Aug 19, 2025
7d98274
Merge branch 'ikawrakow:main' into main
Thireus Aug 21, 2025
74648ce
Merge branch 'ikawrakow:main' into main
Thireus Aug 21, 2025
4cd0350
Merge branch 'ikawrakow:main' into main
Thireus Aug 22, 2025
d84fae0
Merge branch 'ikawrakow:main' into main
Thireus Aug 23, 2025
73b417f
Merge branch 'ikawrakow:main' into main
Thireus Aug 24, 2025
f803740
Merge branch 'ikawrakow:main' into main
Thireus Aug 24, 2025
d51feaf
Merge branch 'ikawrakow:main' into main
Thireus Aug 25, 2025
0ce66fb
Merge branch 'ikawrakow:main' into main
Thireus Aug 26, 2025
ee66256
Merge branch 'ikawrakow:main' into main
Thireus Aug 27, 2025
ee719cc
Merge branch 'ikawrakow:main' into main
Thireus Aug 28, 2025
f23b10c
Merge branch 'ikawrakow:main' into main
Thireus Aug 29, 2025
d590473
Merge branch 'ikawrakow:main' into main
Thireus Aug 31, 2025
ce1cc30
Merge branch 'ikawrakow:main' into main
Thireus Aug 31, 2025
4aab641
Merge branch 'ikawrakow:main' into main
Thireus Sep 2, 2025
b3f6386
Merge branch 'ikawrakow:main' into main
Thireus Sep 2, 2025
b1f99ef
Merge branch 'ikawrakow:main' into main
Thireus Sep 4, 2025
3805be6
Merge branch 'ikawrakow:main' into main
Thireus Sep 5, 2025
fcc2365
Merge branch 'ikawrakow:main' into main
Thireus Sep 5, 2025
64ce118
Merge branch 'ikawrakow:main' into main
Thireus Sep 5, 2025
803c79a
Merge branch 'ikawrakow:main' into main
Thireus Sep 10, 2025
fda9a42
Merge branch 'ikawrakow:main' into main
Thireus Sep 11, 2025
35fcf84
Merge branch 'ikawrakow:main' into main
Thireus Sep 13, 2025
7793fe2
Merge branch 'ikawrakow:main' into main
Thireus Sep 24, 2025
f47f201
Merge branch 'ikawrakow:main' into main
Thireus Sep 24, 2025
f536886
Merge branch 'ikawrakow:main' into main
Thireus Sep 24, 2025
e2d3f8d
Merge branch 'ikawrakow:main' into main
Thireus Sep 24, 2025
f147107
Merge branch 'ikawrakow:main' into main
Thireus Sep 25, 2025
eedb5ce
Merge branch 'ikawrakow:main' into main
Thireus Sep 26, 2025
5f937c9
Merge branch 'ikawrakow:main' into main
Thireus Sep 26, 2025
6ae1438
Merge branch 'ikawrakow:main' into main
Thireus Sep 27, 2025
0646473
Merge branch 'ikawrakow:main' into main
Thireus Sep 27, 2025
42d8c6a
Merge branch 'ikawrakow:main' into main
Thireus Sep 30, 2025
0ed1f38
Merge branch 'ikawrakow:main' into main
Thireus Oct 1, 2025
b74a57c
Merge branch 'ikawrakow:main' into main
Thireus Oct 5, 2025
2c2e271
Merge branch 'ikawrakow:main' into main
Thireus Oct 11, 2025
8dab473
Merge branch 'ikawrakow:main' into main
Thireus Oct 13, 2025
59a004e
Update release.yml
Thireus Oct 13, 2025
073fd6d
Update release.yml
Thireus Oct 13, 2025
0ce23a6
Update ggml-common.h
Thireus Oct 13, 2025
23db969
Update ggml-common.h
Thireus Oct 13, 2025
21354e8
Update ggml-common.h
Thireus Oct 13, 2025
7c0f4ca
Merge branch 'ikawrakow:main' into main
Thireus Oct 13, 2025
3403e82
Merge branch 'ikawrakow:main' into main
Thireus Oct 14, 2025
8906d11
Merge branch 'ikawrakow:main' into main
Thireus Oct 15, 2025
1350201
Merge branch 'ikawrakow:main' into main
Thireus Oct 16, 2025
a2dd06c
Merge branch 'ikawrakow:main' into main
Thireus Oct 17, 2025
fa54b5b
Merge branch 'ikawrakow:main' into main
Thireus Oct 18, 2025
5f6f378
Merge branch 'ikawrakow:main' into main
Thireus Oct 19, 2025
7368fd5
Merge branch 'ikawrakow:main' into main
Thireus Oct 20, 2025
12a894e
Merge branch 'ikawrakow:main' into main
Thireus Oct 20, 2025
1b417f5
Merge branch 'ikawrakow:main' into main
Thireus Oct 20, 2025
53ea164
Merge branch 'ikawrakow:main' into main
Thireus Oct 21, 2025
eab56f6
Merge branch 'ikawrakow:main' into main
Thireus Oct 21, 2025
e7ad8d9
Merge branch 'ikawrakow:main' into main
Thireus Oct 21, 2025
3d66557
Merge branch 'ikawrakow:main' into main
Thireus Oct 22, 2025
3ed37d2
Merge branch 'ikawrakow:main' into main
Thireus Oct 22, 2025
9350952
Merge branch 'ikawrakow:main' into main
Thireus Oct 23, 2025
7a461f1
Merge branch 'ikawrakow:main' into main
Thireus Oct 24, 2025
8780a09
Merge branch 'ikawrakow:main' into main
Thireus Oct 26, 2025
c7424c9
Merge branch 'ikawrakow:main' into main
Thireus Oct 26, 2025
586a6e6
Merge branch 'ikawrakow:main' into main
Thireus Oct 27, 2025
0e9059d
Merge branch 'ikawrakow:main' into main
Thireus Oct 28, 2025
bc00169
Merge branch 'ikawrakow:main' into main
Thireus Oct 28, 2025
3a55c53
Merge branch 'ikawrakow:main' into main
Thireus Oct 29, 2025
ef49b83
Merge branch 'ikawrakow:main' into main
Thireus Oct 29, 2025
08dbb7f
Merge pull request #29 from ikawrakow/main
Thireus Oct 30, 2025
53c7986
Merge branch 'ikawrakow:main' into main
Thireus Oct 31, 2025
4462755
Merge branch 'ikawrakow:main' into main
Thireus Nov 4, 2025
2f66116
Add AVX512 flags to CMakeLists.txt
machoretro Nov 4, 2025
90c23c3
Merge branch 'ikawrakow:main' into main
Thireus Nov 4, 2025
ad58519
Merge pull request #36 from machoretro/patch-4
Thireus Nov 4, 2025
7a5a689
Merge branch 'ikawrakow:main' into main
Thireus Nov 5, 2025
741a5e2
Merge branch 'ikawrakow:main' into main
Thireus Nov 5, 2025
c0123c2
Merge branch 'ikawrakow:main' into main
Thireus Nov 6, 2025
40c1fdd
Merge branch 'ikawrakow:main' into main
Thireus Nov 6, 2025
ecb8c86
Merge branch 'ikawrakow:main' into main
Thireus Nov 7, 2025
86606c2
Merge branch 'ikawrakow:main' into main
Thireus Nov 7, 2025
523d182
Merge branch 'ikawrakow:main' into main
Thireus Nov 8, 2025
ffe321f
Merge branch 'ikawrakow:main' into main
Thireus Nov 8, 2025
fc87e37
Merge branch 'ikawrakow:main' into main
Thireus Nov 9, 2025
5953499
Merge branch 'ikawrakow:main' into main
Thireus Nov 9, 2025
ca115a9
Merge branch 'ikawrakow:main' into main
Thireus Nov 10, 2025
cd521dc
Merge branch 'ikawrakow:main' into main
Thireus Nov 10, 2025
d200340
Merge branch 'ikawrakow:main' into main
Thireus Nov 10, 2025
09c61e1
Merge branch 'ikawrakow:main' into main
Thireus Nov 11, 2025
b0c5223
Merge branch 'ikawrakow:main' into main
Thireus Nov 12, 2025
cb94aec
Merge branch 'ikawrakow:main' into main
Thireus Nov 13, 2025
ba2d835
Merge branch 'ikawrakow:main' into main
Thireus Nov 13, 2025
d28c1a7
Merge branch 'ikawrakow:main' into main
Thireus Nov 13, 2025
6d2fed9
Merge branch 'ikawrakow:main' into main
Thireus Nov 14, 2025
1cceeaa
Cast results to __m512i in iqk_gemm_legacy_quants.cpp
Thireus Nov 14, 2025
5dd2acd
Revert "Cast results to __m512i in iqk_gemm_legacy_quants.cpp"
Thireus Nov 15, 2025
88528ee
Resolve MSVC ambiguity in SIMD bitwise operators
Thireus Nov 15, 2025
a97c864
Merge branch 'ikawrakow:main' into main
Thireus Nov 15, 2025
11c246c
Resolve MSVC ambiguity in SIMD bitwise operators
Thireus Nov 15, 2025
c126d8a
Bugfix attempt2 - redefinition
Thireus Nov 15, 2025
a822763
bugfix attempt3
Thireus Nov 15, 2025
e313c65
bugfix attempt4
Thireus Nov 15, 2025
43247b0
Revert "bugfix attempt4"
Thireus Nov 15, 2025
35adf15
Revert "bugfix attempt3"
Thireus Nov 15, 2025
2f8a38f
Revert "Bugfix attempt2 - redefinition"
Thireus Nov 15, 2025
f4f4844
Revert "Resolve MSVC ambiguity in SIMD bitwise operators"
Thireus Nov 15, 2025
a70e8cf
Revert "Resolve MSVC ambiguity in SIMD bitwise operators"
Thireus Nov 15, 2025
579f42f
Merge branch 'ikawrakow:main' into main
Thireus Nov 15, 2025
2fb247d
Revert "Add missing AVX512 operators for MSVC (#948)"
Thireus Nov 15, 2025
279bee3
Merge branch 'main' of https://github.com/Thireus/ik_llama.cpp
Thireus Nov 15, 2025
7723dec
Merge branch 'ikawrakow:main' into main
Thireus Nov 16, 2025
d97ac64
Merge branch 'ikawrakow:main' into main
Thireus Nov 18, 2025
3c54a45
Merge branch 'ikawrakow:main' into main
Thireus Nov 18, 2025
9ded0c4
Merge branch 'ikawrakow:main' into main
Thireus Nov 19, 2025
5882232
Merge branch 'ikawrakow:main' into main
Thireus Nov 19, 2025
ffa577e
Merge branch 'ikawrakow:main' into main
Thireus Nov 19, 2025
b2ba459
Merge branch 'ikawrakow:main' into main
Thireus Nov 19, 2025
897a2c1
Merge branch 'ikawrakow:main' into main
Thireus Nov 21, 2025
982b93c
Merge branch 'ikawrakow:main' into main
Thireus Nov 24, 2025
409ecf9
Merge branch 'ikawrakow:main' into main
Thireus Nov 24, 2025
857b4f6
Merge branch 'ikawrakow:main' into main
Thireus Nov 26, 2025
1a21026
Merge branch 'ikawrakow:main' into main
Thireus Nov 26, 2025
7ba8b54
Merge branch 'ikawrakow:main' into main
Thireus Nov 27, 2025
14e10f5
Merge branch 'ikawrakow:main' into main
Thireus Nov 29, 2025
da8b3a5
Merge branch 'ikawrakow:main' into main
Thireus Nov 30, 2025
38b1232
Merge branch 'ikawrakow:main' into main
Thireus Dec 1, 2025
f54d377
Merge branch 'ikawrakow:main' into main
Thireus Dec 2, 2025
d70a752
Merge branch 'ikawrakow:main' into main
Thireus Dec 3, 2025
83bba6d
Merge branch 'ikawrakow:main' into main
Thireus Dec 4, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions .github/actions/get-tag-name/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
name: "Determine tag name"
description: "Determine the tag name to use for a release"
outputs:
name:
description: "The name of the tag"
value: ${{ steps.tag.outputs.name }}

runs:
using: "composite"
steps:
- name: Determine tag name
id: tag
shell: bash
run: |
BUILD_NUMBER="$(git rev-list --count HEAD)"
SHORT_HASH="$(git rev-parse --short=7 HEAD)"
if [[ "${{ env.BRANCH_NAME }}" == "master" ]]; then
echo "name=b${BUILD_NUMBER}" >> $GITHUB_OUTPUT
else
SAFE_NAME=$(echo "${{ env.BRANCH_NAME }}" | tr '/' '-')
echo "name=${SAFE_NAME}-b${BUILD_NUMBER}-${SHORT_HASH}" >> $GITHUB_OUTPUT
fi
67 changes: 67 additions & 0 deletions .github/actions/windows-setup-cuda/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
name: "Windows - Setup CUDA Toolkit"
description: "Setup CUDA Toolkit for Windows"
inputs:
cuda_version:
description: "CUDA toolkit version"
required: true

runs:
using: "composite"
steps:
- name: Install Cuda Toolkit 11.7
if: ${{ inputs.cuda_version == '11.7' }}
shell: pwsh
run: |
mkdir -p "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7"
choco install unzip -y
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cudart/windows-x86_64/cuda_cudart-windows-x86_64-11.7.99-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvcc/windows-x86_64/cuda_nvcc-windows-x86_64-11.7.99-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvrtc/windows-x86_64/cuda_nvrtc-windows-x86_64-11.7.99-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libcublas/windows-x86_64/libcublas-windows-x86_64-11.7.4.6-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvtx/windows-x86_64/cuda_nvtx-windows-x86_64-11.7.91-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/visual_studio_integration/windows-x86_64/visual_studio_integration-windows-x86_64-11.7.91-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvprof/windows-x86_64/cuda_nvprof-windows-x86_64-11.7.101-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cccl/windows-x86_64/cuda_cccl-windows-x86_64-11.7.91-archive.zip"
unzip '*.zip' -d "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7"
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_cudart-windows-x86_64-11.7.99-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_nvcc-windows-x86_64-11.7.99-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_nvrtc-windows-x86_64-11.7.99-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\libcublas-windows-x86_64-11.7.4.6-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_nvtx-windows-x86_64-11.7.91-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\visual_studio_integration-windows-x86_64-11.7.91-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_nvprof-windows-x86_64-11.7.101-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\cuda_cccl-windows-x86_64-11.7.91-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" /E /I /H /Y
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\bin" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7\libnvvp" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V11_7=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8

- name: Install Cuda Toolkit 12.8
if: ${{ inputs.cuda_version == '12.8' }}
shell: pwsh
run: |
mkdir -p "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8"
choco install unzip -y
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cudart/windows-x86_64/cuda_cudart-windows-x86_64-12.8.90-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvcc/windows-x86_64/cuda_nvcc-windows-x86_64-12.8.93-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvrtc/windows-x86_64/cuda_nvrtc-windows-x86_64-12.8.93-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libcublas/windows-x86_64/libcublas-windows-x86_64-12.8.4.1-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvtx/windows-x86_64/cuda_nvtx-windows-x86_64-12.8.90-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_profiler_api/windows-x86_64/cuda_profiler_api-windows-x86_64-12.8.90-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/visual_studio_integration/windows-x86_64/visual_studio_integration-windows-x86_64-12.8.90-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvprof/windows-x86_64/cuda_nvprof-windows-x86_64-12.8.90-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cccl/windows-x86_64/cuda_cccl-windows-x86_64-12.8.90-archive.zip"
unzip '*.zip' -d "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8"
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_cudart-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_nvcc-windows-x86_64-12.8.93-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_nvrtc-windows-x86_64-12.8.93-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\libcublas-windows-x86_64-12.8.4.1-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_nvtx-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_profiler_api-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\visual_studio_integration-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_nvprof-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\cuda_cccl-windows-x86_64-12.8.90-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" /E /I /H /Y
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\libnvvp" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V12_8=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
30 changes: 30 additions & 0 deletions .github/actions/windows-setup-curl/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
name: 'Windows - Setup CURL'
description: 'Composite action, to be reused in other workflow'
inputs:
curl_version:
description: 'CURL version'
required: false
default: '8.6.0_6'
architecture:
description: 'Architecture of the libcurl to download'
required: false
default: 'win64'
outputs:
curl_path:
description: "Path to the downloaded libcurl"
value: ${{ steps.get_libcurl.outputs.curl_path }}

runs:
using: "composite"
steps:
- name: libCURL
id: get_libcurl
shell: powershell
env:
CURL_VERSION: ${{ inputs.curl_version }}
ARCHITECTURE: ${{ inputs.architecture }}
run: |
curl.exe -o $env:RUNNER_TEMP/curl.zip -L "https://curl.se/windows/dl-${env:CURL_VERSION}/curl-${env:CURL_VERSION}-${env:ARCHITECTURE}-mingw.zip"
mkdir $env:RUNNER_TEMP/libcurl
tar.exe -xvf $env:RUNNER_TEMP/curl.zip --strip-components=1 -C $env:RUNNER_TEMP/libcurl
echo "curl_path=$env:RUNNER_TEMP/libcurl" >> $env:GITHUB_OUTPUT
88 changes: 88 additions & 0 deletions .github/labeler.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,88 @@
# https://github.com/actions/labeler
Kompute:
- changed-files:
- any-glob-to-any-file:
- ggml/include/ggml-kompute.h
- ggml/src/ggml-kompute/**
- README-kompute.md
Apple Metal:
- changed-files:
- any-glob-to-any-file:
- ggml/include/ggml-metal.h
- ggml/src/ggml-metal/**
- README-metal.md
SYCL:
- changed-files:
- any-glob-to-any-file:
- ggml/include/ggml-sycl.h
- ggml/src/ggml-sycl/**
- docs/backend/SYCL.md
- examples/sycl/**
Nvidia GPU:
- changed-files:
- any-glob-to-any-file:
- ggml/include/ggml-cuda.h
- ggml/src/ggml-cuda/**
Vulkan:
- changed-files:
- any-glob-to-any-file:
- ggml/include/ggml-vulkan.h
- ggml/src/ggml-vulkan/**
documentation:
- changed-files:
- any-glob-to-any-file:
- docs/**
- media/**
testing:
- changed-files:
- any-glob-to-any-file:
- tests/**
build:
- changed-files:
- any-glob-to-any-file:
- cmake/**
- CMakeLists.txt
- CMakePresets.json
examples:
- changed-files:
- any-glob-to-any-file:
- examples/**
- tools/**
devops:
- changed-files:
- any-glob-to-any-file:
- .devops/**
- .github/**
- ci/**
python:
- changed-files:
- any-glob-to-any-file:
- "**/*.py"
- requirements/**
- gguf-py/**
- .flake8
script:
- changed-files:
- any-glob-to-any-file:
- scripts/**
android:
- changed-files:
- any-glob-to-any-file:
- examples/llama.android/**
server:
- changed-files:
- any-glob-to-any-file:
- tools/server/**
ggml:
- changed-files:
- any-glob-to-any-file:
- ggml/**
nix:
- changed-files:
- any-glob-to-any-file:
- "**/*.nix"
- .github/workflows/nix-*.yml
- .devops/nix/nixpkgs-instances.nix
embedding:
- changed-files:
- any-glob-to-any-file: examples/embedding/
Loading
Loading