NVIDIA NeMo Evaluator Launcher 0.2.4

Changelog Details

• feat: deploy auxiliary endpoints by @wprazuch :: PR: #830
• feat: add launching-evals and accessing-mlflow skills by @piojanu :: PR: #865
• feat: rename to nel skills add and add marketplace entries by @piojanu :: PR: #868

NVIDIA NeMo Evaluator 0.2.5

Changelog Details

• feat: add --platform flag for BYOB container builds by @laszkiewiczp :: PR: #832
• chore: Remove duplicated skill for byob, add it to readme and marketplace by @wprazuch :: PR: #845
• fix: remove deprecated api_key field from ApiEndpoint by @gchlebus :: PR: #850

NVIDIA NeMo Evaluator Launcher 0.2.3

Changelog Details

• docs(nemotron-3-super): reproducible configs by @prokotg :: PR: #840
• docs(SKILL.md): add ARM64 and non-standard GPU compatibility note by @himorishige :: PR: #818
• fix(deprecated-multiple-instances-flag): fix deprecated multiple instances by @AWarno :: PR: #838
• fix(nel-assistant): correct --model-type to --model_type in SKILL.md by @himorishige :: PR: #813
• feat(malformed-configs-validation): validation of malformed configs by @AWarno :: PR: #811
• fix: fixes for user-reported bugs after 0.2 release by @marta-sd :: PR: #837
• docs(post_cmd): add post_cmd documentation by @e-dobrowolska :: PR: #841
• feat: add configurable health check timeout for local executor by @laszkiewiczp :: PR: #844
• chore: Simplify launcher evaluation templates and skill guidance by @piojanu :: PR: #846
• chore: Remove duplicated skill for byob, add it to readme and marketplace by @wprazuch :: PR: #845
• chore: Update for 26.03 by @wprazuch :: PR: #852
• chore: VLMEvalkit bump by @wprazuch :: PR: #853
• fix: bypass unlisted-task safeguard for local .sqsh by @gchlebus :: PR: #849

NVIDIA NeMo Evaluator 0.2.4

Changelog Details

• feat: ECS refactor by @Glorf :: PR: #785

NVIDIA NeMo Evaluator 0.2.3

Changelog Details

• chore: fix env resolution in BYOB by @wprazuch :: PR: #831

NVIDIA NeMo Evaluator Launcher 0.2.2

Changelog Details

NVIDIA NeMo Evaluator 0.2.2

Changelog Details

NVIDIA NeMo Evaluator 0.2.1

Changelog Details

• chore: improve test payloads for capabilities and logs for non-image media types by @marta-sd :: PR: #824

NVIDIA NeMo Evaluator Launcher 0.2.1

Changelog Details

NVIDIA NeMo Evaluator 0.2.0

Changelog Details

• feat: enable progress tracking in status CLI (EVAL-377) by @gchlebus :: PR: #780
• fix: hotfixes by @marta-sd :: PR: #806
• feat: add benchmark-required capabilities by @marta-sd :: PR: #792