You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/examples/agents/optimas-examples.md
+10Lines changed: 10 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,6 +6,16 @@ title: Optimas Examples
6
6
7
7
Working examples and demos for all Optimas integration targets. These examples have been verified to work correctly with the latest SuperOptiX version.
Copy file name to clipboardExpand all lines: docs/guides/optimas-integration.md
+71Lines changed: 71 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,6 +6,67 @@ title: Optimas Integration Guide
6
6
7
7
SuperOptiX integrates seamlessly with the **Optimas** framework, enabling you to use advanced prompt optimization techniques (OPRO, MIPRO, COPRO) with multiple LLM frameworks including **OpenAI SDK**, **CrewAI**, **AutoGen**, and **DSPy**.
8
8
9
+
> About Optimas: Optimas optimizes compound AI systems using globally aligned Local Reward Functions (LRFs) so that local improvements translate to higher end‑to‑end performance. Learn more on the official site and paper:
- LiteLLM (used by some targets): [github.com/BerriAI/litellm](https://github.com/BerriAI/litellm)
21
+
22
+
## What Optimas is (and why it matters)
23
+
24
+
[Optimas](https://optimas.stanford.edu) is a unified optimization framework for compound AI systems:
25
+
26
+
- Learns a Local Reward Function (LRF) per component that remains globally aligned, so local updates are safe and beneficial to the whole system. This enables efficient optimization without always running the entire pipeline. See: [arXiv: 2507.03041](https://www.arxiv.org/pdf/2507.03041).
27
+
- Supports heterogeneous configuration types:
28
+
- Prompts and textual instructions via metric‑guided search
29
+
- Hyperparameters and discrete choices (e.g., top‑k, tool/model selection, routing)
30
+
- Model parameters where supported (e.g., RL with PPO)
31
+
- Works across frameworks via target adapters: [OpenAI Agent SDK](https://platform.openai.com/docs/agents), [CrewAI](https://docs.crewai.com), [AutoGen](https://microsoft.github.io/autogen/), and [DSPy](https://dspy.ai)
32
+
- Compound‑system optimization: operates across multiple components and tools, not just single prompts
- Optimize prompts, hyperparameters, model parameters, and model routers across compound AI systems
38
+
- Run OPRO, MIPRO, and COPRO optimization loops through a single CLI workflow
39
+
- Keep your preferred agent stack (DSPy, CrewAI, AutoGen, OpenAI SDK) and get consistent optimization behavior
40
+
41
+
## Why this is impactful
42
+
43
+
- Globally aligned local rewards: maximizing a component’s local reward increases overall system quality, improving data efficiency by reducing full system runs
44
+
- Heterogeneous updates across prompts, hyperparameters, routing/model selection, and (where applicable) model parameters via RL
45
+
- Reported average relative improvement of 11.92% across five compound systems with theoretical guarantees and strong empirical results:
Optimas integrates into the standard SuperOptiX lifecycle:
52
+
53
+
1. Compile your agent for a specific target
54
+
2. Evaluate to establish a baseline
55
+
3. Optimize with Optimas (OPRO/MIPRO/COPRO) using the same CLI across targets
56
+
4. Run the optimized agent
57
+
58
+
This extends optimization beyond prompts to hyperparameters, model selection/routing, and parameters where supported.
59
+
60
+
- Focus‑aligned: SuperOptiX is built for optimization; Optimas operationalizes it across agents and tools
61
+
- Beyond prompts: optimize prompts, hyperparameters, parameters, and routers for production workflows
62
+
- One CLI to rule them all: compile → evaluate → optimize → run across all targets
63
+
64
+
## Optimas vs. DSPy (complementary)
65
+
66
+
-[DSPy](https://dspy.ai) is a framework for composing LLM pipelines and programmatic teleprompting
67
+
- Optimas is an optimization engine that runs globally aligned local updates across multi‑component systems, regardless of the underlying framework (including DSPy)
68
+
- In practice: build in your preferred stack; use Optimas to optimize end‑to‑end. If using DSPy, try `--optimizer mipro` for deeper prompt refinement (OPRO and COPRO also supported)
0 commit comments