ci: add test binaries workflow #184
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request introduces a new GitHub Actions workflow,
test-binaries.yml, to automate testing of binaries across multiple operating systems and configurations. The workflow ensures compatibility and correctness of thellama-serverbinaries by running startup and inference tests in a matrix of environments.New GitHub Actions workflow for binary testing:
Workflow setup: Added a new workflow,
test-binaries.yml, triggered on pull requests to thedevbranch or manually viaworkflow_dispatch. It supports testing binaries for Linux, macOS, and Windows with various configurations (e.g., AVX, AVX512, Vulkan).Matrix strategy: Defined a matrix of environments, including different OS versions (Ubuntu 20.04/22.04, macOS 12, Windows with CUDA 11.7/12.0) and binary configurations (e.g., AVX, no-AVX, Vulkan).
Testing steps:
chmod +xfor Linux/macOS).llama-serverbinary starts correctly and responds to health checks. Separate implementations are provided for Linux/macOS