Skip to content

Conversation

danbev
Copy link
Member

@danbev danbev commented May 21, 2025

This commit updates the windows-blas job to use the dynamic (can load different kernels depending of the CPU arch) libopenblas.dll instead of the "static" openblas.dll that get installed by vcpgk.

The motivation for this change is that there have been reports of performance drops in later version specifically related to blas. Please see the links below for more details.

Resolves: #3166
Refs: #2666 (comment)

This commit updates the windows-blas job to use the dynamic (can load
different kernels depending of the CPU arch) libopenblas.dll instead of
the "static" openblas.dll that get installed by vcpgk.

The motivation for this change is that there have been reports of
performance drops in later version specifically related to blas. Please
see the links below for more details.

Resolves: ggml-org#3166
Refs: ggml-org#2666 (comment)
@danbev
Copy link
Member Author

danbev commented May 21, 2025

To tests this, download whisper-blas-bin-x64.zip.zip and then extract it:

> mkdir temp
> tar xvf .\whisper-blas-bin-x64.zip.zip
> tar xvf .\whisper-blas-bin-x64.zip
> cd .\Release\
> ls


    Directory: C:\win-temp-dir\Release


Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         5/21/2025   6:36 AM          27136 bench.exe
-a----         5/21/2025   6:36 AM          27136 command.exe
-a----         5/21/2025   6:36 AM         494080 ggml-base.dll
-a----         5/21/2025   6:36 AM          54272 ggml-blas.dll
-a----         5/21/2025   6:37 AM         456192 ggml-cpu.dll
-a----         5/21/2025   6:37 AM          69120 ggml.dll
-a----         1/12/2025   4:34 PM       51126150 libopenblas.dll
-a----         5/21/2025   6:37 AM         184320 lsp.exe
-a----         5/21/2025   6:37 AM          27136 main.exe
-a----         5/21/2025   6:37 AM         108032 quantize.exe
-a----         11/2/2023   5:05 PM        2500096 SDL2.dll
-a----         5/21/2025   6:37 AM          27136 stream.exe
-a----         5/21/2025   6:37 AM         363008 test-vad-full.exe
-a----         5/21/2025   6:37 AM         363008 test-vad.exe
-a----         5/21/2025   6:37 AM         370688 vad-speech-segments.exe
-a----         5/21/2025   6:37 AM         165888 wchess.exe
-a----         5/21/2025   6:37 AM          20480 whisper-bench.exe
-a----         5/21/2025   6:37 AM         480768 whisper-cli.exe
-a----         5/21/2025   6:37 AM         167936 whisper-command.exe
-a----         5/21/2025   6:37 AM         713216 whisper-server.exe
-a----         5/21/2025   6:38 AM         388096 whisper-stream.exe
-a----         5/21/2025   6:39 AM        1529344 whisper-talk-llama.exe
-a----         5/21/2025   6:37 AM         492032 whisper.dll

Notice that we are now including libopenblas.dll instead of openblas.dll.

Note: I'll take a look at why this becomes .zip.zip.

@danbev danbev requested a review from ggerganov May 22, 2025 11:57
@danbev
Copy link
Member Author

danbev commented May 22, 2025

I'll go over the other upload steps in the next few days and make sure they are consistent and don't have the double .zip file extension as well.

@danbev danbev merged commit aab6976 into ggml-org:master May 23, 2025
53 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci : update windows-blas job to use multi-target OpenBLAS .dll

2 participants