Test different hardware acceleration methods out with whisper.cpp - #109
Open
mike-malburg wants to merge 32 commits into
Open
Test different hardware acceleration methods out with whisper.cpp#109mike-malburg wants to merge 32 commits into
mike-malburg wants to merge 32 commits into
Conversation
Adding whisper models so we can test whisper builds post-build on the server.
The build servers put AVX-512 instructions into the build even if we don't specifically enable it, so we need to force it to NOT do this if we don't have a feature flag specifically turned on for this. This is important, because even though the build server may support avx-512, customer machines may NOT, and having those instructions present in the dll can cause crashes in whisper.
We will use these to perform tests on whisper builds.
With always(), logs are now published regardless of build outcome (success, failure, or cancellation), as long as: - publishToPipelineArtifacts parameter is enabled - Logs exist in the staging directory
We will need this later to detect if we need to install certain prerequisites on the machine before building (ex. Vulkan SDKs for Vulkan).
Update the existing pre-build scripts to accept this new param we are now passing to them
Add accelerate framework support for whisper. This is basically Apple's way of doing BLAS.
This will cause the pipeline to build on an Apple Silicon Mac. This image is not production-ready, yet, according to Microsoft. I am just temporarily adding this here so that I can easily run tests on an Apple Silicon Mac while testing this pipeline.
We previously had 2 whisper ports that were nearly identical: whispercpp and whispercpp-basic. The changes in this branch have allowed us to move this to one port that just takes different feature flags. These old ports are now obsolete.
This reverts commit 817288e.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.