v0.1.3-alpha

[ividal]

Features

• Support translation experiments and multilingual models via UI.
• Add COMET metric for translation evaluation.
• Allow filtering models by use-case during experiment creation.
• Deploy models using vLLM and Ray Serve with batch inference.
• Replace deprecated Mistral-7B model with Ministral-8B.
• Toggle columns and support nested tables in DatasetViewer.
• Settings configuration via SDK and UI includes secret management.
• Evaluate DeepSeek R1 model variants.

Bugfixes

• Fix redaction bug in parsing model name/path.
• Correct secrets handling for OpenAI API, mistralAPIKey, and MLflow persistence.
• Resolve filename generation issues in datasets.
• Correct API key usage format in UI (api-key → api_key).
• Ray server now waits to fully start before accepting requests.
• Fix typo issue in models.yaml file.
• Small bugfixes in jobs and annotation API key support.

Refactoring

• Modularize HuggingFaceModelClient components.
• Refactor job inference code and increase test coverage.
• Improve startup performance and async error handling for Ray workflows.
• Adjust logging methods for workflows, remove unused log statements.
• Explicit environment variable handling and container optimizations.
• Enhance workflow/job validation logic.
• Update pre-commit, CI, Makefile, configs, and scripts for consistency.

Documentation

• Update documentation to reflect API key settings changes.
• Correct task terminology from "task" to "task_definition".
• Minor doc improvements and updated UI guide images.

Full Changelog: v0.1.2-alpha...v0.1.3-alpha

---

This discussion was created from the release v0.1.3-alpha.