feat(evaluation): Add lm-eval to Pruna Metrics · PrunaAI/pruna@d0a01fb

Re-run triggered March 12, 2026 13:32

begumcig

#380

sky-2002:sky-2002/metric-evalharness

Status Cancelled

Total duration 2m 15s

Artifacts –

tests.yaml

on: pull_request

Matrix: linting

Matrix: test

Annotations

3 errors and 11 warnings

linting (3.11)

Canceling since a higher priority waiting request for ci-PrunaAI/pruna-tests-refs/pull/380/merge exists

linting (3.11)

The operation was canceled.

Code Quality & Tests

Canceling since a higher priority waiting request for ci-PrunaAI/pruna-tests-refs/pull/380/merge exists

linting (3.11)

Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-python@v5, astral-sh/setup-uv@v6. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

linting (3.11)