Skip to content

v0.2.3

Choose a tag to compare

View all tags
@codelion codelion released this 08 Sep 06:39
· 104 commits to main since this release
v0.2.3
ec334d6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

OptiLLM v0.2.3 Release Notes

🚀 New Features

Proxy Plugin for Load Balancing

  • New Plugin: proxy - Load balancing and failover across multiple LLM providers
  • Round-robin, weighted, and failover routing strategies
  • Health monitoring with automatic recovery
  • YAML configuration at ~/.optillm/proxy_config.yaml

Deep Confidence Reasoning

  • New Technique: deepconf - Confidence-guided reasoning with inference-time scaling
  • Based on https://arxiv.org/abs/2508.15260 research
  • Enhanced accuracy through confidence-guided reasoning

🔧 Improvements

  • Updated documentation with all techniques and plugins
  • Better pip installation compatibility with PyYAML dependency
  • Added academic references section

📦 Installation

pip install optillm==0.2.3

Full Changelog: v0.2.2...v0.2.3

Assets 2
Loading