Skip to content
Lint, Format, and MyPy

feat: add RULER long context evaluation #547

Sign in to view logs

feat: add RULER long context evaluation

feat: add RULER long context evaluation #547

Triggered via pull request May 5, 2025 16:30
@jaideepr97jaideepr97
synchronize #250
jaideepr97:add-ruler
Status Failure
Total duration 4m 35s
Artifacts –

lint.yml

on: pull_request
Matrix: lint
lint-workflow-complete
0s
lint-workflow-complete
Fit to window
Zoom out
Zoom in

Annotations

3 errors and 10 warnings
ruff
Process completed with exit code 3.
pylint
Process completed with exit code 28.
mypy
Process completed with exit code 1.
pylint: src/instructlab/eval/temp_res.py#L36
C0304: Final newline missing (missing-final-newline)
pylint: src/instructlab/eval/temp_res.py#L3
W0621: Redefining name 'unqiue_metrics_dict' from outer scope (line 19) (redefined-outer-name)
pylint: src/instructlab/eval/temp_res.py#L5
W0621: Redefining name 'k' from outer scope (line 24) (redefined-outer-name)
pylint: src/instructlab/eval/temp_res.py#L5
W0621: Redefining name 'v' from outer scope (line 24) (redefined-outer-name)
pylint: src/instructlab/eval/temp_res.py#L17
W1514: Using open without explicitly specifying an encoding (unspecified-encoding)
pylint: src/instructlab/eval/ruler.py#L233
C0304: Final newline missing (missing-final-newline)
pylint: src/instructlab/eval/ruler.py#L102
W0621: Redefining name 'fpath' from outer scope (line 214) (redefined-outer-name)
pylint: src/instructlab/eval/ruler.py#L128
W1514: Using open without explicitly specifying an encoding (unspecified-encoding)
pylint: src/instructlab/eval/ruler.py#L154
W0613: Unused argument 'vllm_config' (unused-argument)
pylint: src/instructlab/eval/ruler.py#L155
W0613: Unused argument 'hf_config' (unused-argument)