Skip to content

Conversation

@Minh141120
Copy link
Member

This pull request introduces a new GitHub Actions workflow, test-binaries.yml, to automate testing of binaries across multiple operating systems and configurations. The workflow ensures compatibility and correctness of the llama-server binaries by running startup and inference tests in a matrix of environments.

New GitHub Actions workflow for binary testing:

  • Workflow setup: Added a new workflow, test-binaries.yml, triggered on pull requests to the dev branch or manually via workflow_dispatch. It supports testing binaries for Linux, macOS, and Windows with various configurations (e.g., AVX, AVX512, Vulkan).

  • Matrix strategy: Defined a matrix of environments, including different OS versions (Ubuntu 20.04/22.04, macOS 12, Windows with CUDA 11.7/12.0) and binary configurations (e.g., AVX, no-AVX, Vulkan).

  • Testing steps:

    • Binary download and preparation: Downloads and extracts the appropriate binary artifacts for each configuration. Ensures executables are properly set up (e.g., chmod +x for Linux/macOS).
    • Server startup tests: Verifies that the llama-server binary starts correctly and responds to health checks. Separate implementations are provided for Linux/macOS

@Minh141120 Minh141120 self-assigned this Jul 31, 2025
@Minh141120 Minh141120 requested a review from qnixsynapse July 31, 2025 06:22
@Minh141120 Minh141120 force-pushed the ci/add-test-binaries-workflow branch from 05540a2 to 74880d6 Compare July 31, 2025 07:27
@Minh141120 Minh141120 changed the title Ci/add test binaries workflow ci: add test binaries workflow Jul 31, 2025
@Minh141120 Minh141120 added this pull request to the merge queue Jul 31, 2025
Merged via the queue into dev with commit 5f0df8c Jul 31, 2025
@Minh141120 Minh141120 deleted the ci/add-test-binaries-workflow branch July 31, 2025 07:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants