Automatic Prompt Optimizer & Run Kiln Evals on MCP Servers
What's New
- Kiln Automatic Prompt Optimizer: our new state-of-the-art prompt optimizer. We automatically finds high-performing prompts for your task. It often beats manual prompt engineering by double-digit gains on evals. Instead of human trial-and-error, Kiln will run thousands of automated experiments and iteratively find an optimal prompt for a given model and task.
- Optimizer Screen: Our new menu for finding the best way to optimize your task. Pick from options like prompt optimization, model selection, fine-tuning and more.
- MCP Run Configurations: hook a Kiln task up to any external implementation through MCP. This allows you to use Kiln's evals, specs and compare features with your own custom agent implementations.
- New Models: Gemini 3.1 Pro, Sonnet 4.6, GLM 5, Kimi K2.5, Minimax M2.5, Qwen 3.5, and many more!
- And More: Better app layout/design, featured models, model suggestions, model pricing, and more!
CI Build Source for this release Mac and Linux: /Kiln-AI/Kiln/actions/runs/22231831533
CI Build Source for this release Windows: /Kiln-AI/Kiln/actions/runs/22231831526
Full Changelog: v0.24.0...v0.25.0