Skip to content

docs: vulkan build instructions to use git bash mingw64 #10303

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Nov 16, 2024
Merged

docs: vulkan build instructions to use git bash mingw64 #10303

Changes from 4 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
4714ec3
vulkan install instructions git bash mingw64
FirstTimeEZ Nov 15, 2024
2d4eab4
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 15, 2024
d3bddea
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 15, 2024
eb731c0
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 15, 2024
4e856e3
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 15, 2024
7ab4f08
vulkan: build instructions to use git bash mingw64
FirstTimeEZ Nov 15, 2024
6e9d976
vulkan: build instructions to use git bash mingw64
FirstTimeEZ Nov 15, 2024
932f28e
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 15, 2024
a79d81d
docs: vulkan build instructions to use git bash mingw64
FirstTimeEZ Nov 16, 2024
aa51d1d
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 16, 2024
f338cb0
Merge branch 'ggerganov:master' into patch-4
FirstTimeEZ Nov 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions docs/build.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -280,6 +280,46 @@ The following compilation options are also available to tweak performance (yes,

**Windows**

#### Git Bash MINGW64
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Thanks for providing these build instructions.

May I ask why Git Bash recommended here instead of just using the native powershell? I tried with just installing vulkan and clone the repo (I already had vs2022 installed), cmake can automatically find vulkan, everything builds fine in powershell.


[![](https://i.imgur.com/M8dnyk5.png)](https://git-scm.com/downloads/win).

Download and install [`Git-SCM`](https://git-scm.com/downloads/win) with the default settings

[![](https://i.imgur.com/hiAMq2S.png)](https://visualstudio.microsoft.com/)

Download and install [`Visual Studio Community Edition`](https://visualstudio.microsoft.com/) and make sure you select `C++`

[![](https://i.imgur.com/piiceV6.png)](https://cmake.org/download/)

Download and install [`CMake`](https://cmake.org/download/) with the default settings

[![](https://i.imgur.com/cN0LDwJ.png)](https://vulkan.lunarg.com/sdk/home#windows)

Download and install the [`Vulkan SDK`](https://vulkan.lunarg.com/sdk/home#windows) with the default settings.

![](https://i.imgur.com/qTl7jbF.png)

Go into your `llama.cpp` directory and right click, select `Open Git Bash Here` and then run the following commands

![](https://i.imgur.com/7UQ7Rf1.png)

```
cmake -B build -DGGML_VULKAN=ON
```

![](https://i.imgur.com/GlJnitl.png)

```
cmake --build build --config Release
```

Now you can load the model in conversation mode using `Vulkan`

```
build/bin/release/llama-cli -m "[PATH TO MODEL]" -ngl 100 -c 16384 -t 10 -n -2 -cnv
```

#### w64devkit

Download and extract [w64devkit](https://github.com/skeeto/w64devkit/releases).
Expand Down