|
| 1 | +--- |
| 2 | +title: Optimas Examples |
| 3 | +--- |
| 4 | + |
| 5 | +# 🎯 Ready-to-Run Optimas Examples |
| 6 | + |
| 7 | +**Copy-paste commands that actually work.** These examples use the demo agents from `superoptix/agents/optimas/` and show you exactly how to get started with each Optimas target. |
| 8 | + |
| 9 | +--- |
| 10 | + |
| 11 | +## 🚀 Quick Demo (CrewAI Target) |
| 12 | + |
| 13 | +**Start here if you're new to Optimas!** |
| 14 | + |
| 15 | +```bash |
| 16 | +# 1. Create project |
| 17 | +super init demo_optimas && cd demo_optimas |
| 18 | + |
| 19 | +# 2. Install CrewAI target (most reliable) |
| 20 | +pip install superoptix[optimas,optimas-crewai] |
| 21 | + |
| 22 | +# 3. Pull demo agent |
| 23 | +super agent pull optimas_crewai |
| 24 | + |
| 25 | +# 4. Run full workflow |
| 26 | +super agent compile optimas_crewai --target optimas-crewai |
| 27 | +super agent evaluate optimas_crewai --engine optimas --target optimas-crewai |
| 28 | +super agent optimize optimas_crewai --engine optimas --target optimas-crewai |
| 29 | +super agent run optimas_crewai --engine optimas --target optimas-crewai \ |
| 30 | + --goal "Write a Python function to calculate prime numbers" |
| 31 | +``` |
| 32 | + |
| 33 | +**🎉 Result**: You'll have a working, optimized developer agent that generates code! |
| 34 | + |
| 35 | +--- |
| 36 | + |
| 37 | +## 📚 Available Demo Agents |
| 38 | + |
| 39 | +| Agent | Target | Description | Best For | Status | |
| 40 | +|-------|--------|-------------|----------|---------| |
| 41 | +| `optimas_crewai` | `optimas-crewai` | CrewAI framework | **Beginners**, multi-agent workflows | ✅ **100% Working** | |
| 42 | +| `optimas_openai` | `optimas-openai` | OpenAI SDK via Optimas | Simple agents, local development | ✅ **100% Working** | |
| 43 | +| `optimas_autogen` | `optimas-autogen` | AutoGen framework | Conversational agents | ✅ **100% Working** | |
| 44 | +| `optimas_dspy` | `optimas-dspy` | DSPy framework | Research, custom prompting | ✅ **100% Working** | |
| 45 | + |
| 46 | +**🎯 All targets now have 100% success rate!** No more manual fixes needed. |
| 47 | + |
| 48 | +--- |
| 49 | + |
| 50 | +## 🎯 Per-Target Examples |
| 51 | + |
| 52 | +### 1. CrewAI Target (Recommended) |
| 53 | + |
| 54 | +**What it does**: Integrates CrewAI agents with Optimas for team-based workflows. |
| 55 | + |
| 56 | +```bash |
| 57 | +# Install (separate to avoid DSPy conflicts) |
| 58 | +pip install superoptix[optimas,optimas-crewai] |
| 59 | + |
| 60 | +# Pull and setup |
| 61 | +super agent pull optimas_crewai |
| 62 | + |
| 63 | +# Full workflow (no environment variables needed!) |
| 64 | +super agent compile optimas_crewai --target optimas-crewai |
| 65 | +super agent evaluate optimas_crewai --engine optimas --target optimas-crewai |
| 66 | +super agent optimize optimas_crewai --engine optimas --target optimas-crewai |
| 67 | +super agent run optimas_crewai --engine optimas --target optimas-crewai \ |
| 68 | + --goal "Design a software architecture for a web app" |
| 69 | +``` |
| 70 | + |
| 71 | +**✅ Why it's great**: |
| 72 | +- Most reliable for beginners |
| 73 | +- Works well with local Ollama |
| 74 | +- Good for complex multi-step tasks |
| 75 | +- **✅ NEW**: Custom optimization prevents hanging |
| 76 | + |
| 77 | +--- |
| 78 | + |
| 79 | +### 2. OpenAI SDK Target |
| 80 | + |
| 81 | +**What it does**: Wraps OpenAI SDK calls in Optimas for evaluation and optimization. |
| 82 | + |
| 83 | +```bash |
| 84 | +# Install |
| 85 | +pip install superoptix[optimas,optimas-openai] |
| 86 | + |
| 87 | +# Pull and setup |
| 88 | +super agent pull optimas_openai |
| 89 | + |
| 90 | +# Full workflow |
| 91 | +super agent compile optimas_openai --target optimas-openai |
| 92 | +super agent evaluate optimas_openai --engine optimas --target optimas-openai |
| 93 | +super agent optimize optimas_openai --engine optimas --target optimas-openai |
| 94 | +super agent run optimas_openai --engine optimas --target optimas-openai \ |
| 95 | + --goal "Create a Python class for managing a shopping cart" |
| 96 | +``` |
| 97 | + |
| 98 | +**✅ Why it's great**: |
| 99 | +- Simple and straightforward |
| 100 | +- Fast optimization cycles |
| 101 | +- Works with any Ollama model |
| 102 | +- Good for quick prototyping |
| 103 | + |
| 104 | +--- |
| 105 | + |
| 106 | +### 3. AutoGen Target |
| 107 | + |
| 108 | +**What it does**: Wraps AutoGen conversational agents with Optimas optimization. |
| 109 | + |
| 110 | +```bash |
| 111 | +# Install (now includes autogen-ext dependency) |
| 112 | +pip install superoptix[optimas,optimas-autogen] |
| 113 | + |
| 114 | +# Pull and setup |
| 115 | +super agent pull optimas_autogen |
| 116 | + |
| 117 | +# Full workflow |
| 118 | +super agent compile optimas_autogen --target optimas-autogen |
| 119 | +super agent evaluate optimas_autogen --engine optimas --target optimas-autogen |
| 120 | +super agent optimize optimas_autogen --engine optimas --target optimas-autogen |
| 121 | +super agent run optimas_autogen --engine optimas --target optimas-autogen \ |
| 122 | + --goal "Explain quantum computing in simple terms" |
| 123 | +``` |
| 124 | + |
| 125 | +**✅ Why it's great**: |
| 126 | +- **✅ NEW**: `autogen-ext` dependency now included |
| 127 | +- Good for chat-based interactions |
| 128 | +- Stable optimization cycles |
| 129 | +- Works reliably with Ollama |
| 130 | + |
| 131 | +--- |
| 132 | + |
| 133 | +### 4. DSPy Target |
| 134 | + |
| 135 | +**What it does**: Wraps DSPy components inside Optimas for research workflows. |
| 136 | + |
| 137 | +```bash |
| 138 | +# Install with DSPy target |
| 139 | +pip install superoptix[optimas,optimas-dspy] |
| 140 | + |
| 141 | +# Pull and setup |
| 142 | +super agent pull optimas_dspy |
| 143 | + |
| 144 | +# Full workflow |
| 145 | +super agent compile optimas_dspy --target optimas-dspy |
| 146 | +super agent evaluate optimas_dspy --engine optimas --target optimas-dspy |
| 147 | +super agent optimize optimas_dspy --engine optimas --target optimas-dspy |
| 148 | +super agent run optimas_dspy --engine optimas --target optimas-dspy \ |
| 149 | + --goal "Generate a research hypothesis about AI safety" |
| 150 | +``` |
| 151 | + |
| 152 | +**✅ Why it's great**: |
| 153 | +- **✅ NEW**: Templates now include proper LLM configuration |
| 154 | +- Access to MIPRO/COPRO optimizers |
| 155 | +- Research-grade prompting strategies |
| 156 | +- No more "No LLM config found" errors |
| 157 | + |
| 158 | +--- |
| 159 | + |
| 160 | +## 🔧 Customization Examples |
| 161 | + |
| 162 | +### Change the Model |
| 163 | + |
| 164 | +Edit your agent's playbook to use different models: |
| 165 | + |
| 166 | +```yaml |
| 167 | +# In agents/optimas_crewai/playbook/optimas_crewai_playbook.yaml |
| 168 | +spec: |
| 169 | + language_model: |
| 170 | + provider: ollama |
| 171 | + model: ollama/llama3.1:8b # Change to different model |
| 172 | + base_url: http://localhost:11434 # ✅ NEW: No /v1 prefix needed |
| 173 | + api_key: ollama |
| 174 | +``` |
| 175 | +
|
| 176 | +### Add More Test Scenarios |
| 177 | +
|
| 178 | +```yaml |
| 179 | +# Add to feature_specifications.scenarios |
| 180 | +- name: complex_algorithm |
| 181 | + input: |
| 182 | + feature_requirement: "Implement a binary search tree with insert, delete, and search operations" |
| 183 | + expected_output: |
| 184 | + implementation: string |
| 185 | +- name: data_structures |
| 186 | + input: |
| 187 | + feature_requirement: "Create a priority queue using a min-heap" |
| 188 | + expected_output: |
| 189 | + implementation: string |
| 190 | +``` |
| 191 | +
|
| 192 | +### Custom Optimization Parameters |
| 193 | +
|
| 194 | +```bash |
| 195 | +# Control optimization behavior (optional) |
| 196 | +SUPEROPTIX_OPRO_NUM_CANDIDATES=3 \ |
| 197 | +SUPEROPTIX_OPRO_MAX_TOKENS=1000 \ |
| 198 | +SUPEROPTIX_OPRO_MAX_WORKERS=2 \ |
| 199 | +super agent optimize optimas_crewai --engine optimas --target optimas-crewai |
| 200 | +``` |
| 201 | + |
| 202 | +--- |
| 203 | + |
| 204 | +## 🚨 Troubleshooting |
| 205 | + |
| 206 | +### ✅ **Most Issues Are Now Fixed!** |
| 207 | + |
| 208 | +| Issue | Status | Solution | |
| 209 | +|-------|--------|----------| |
| 210 | +| **"No LLM config found" (DSPy)** | ✅ **FIXED** | Templates now include proper LLM configuration | |
| 211 | +| **"AutoGen is required" errors** | ✅ **FIXED** | `autogen-ext` dependency now included | |
| 212 | +| **Optimization hangs** | ✅ **FIXED** | Custom CrewAI optimization prevents hanging | |
| 213 | +| **Base URL issues** | ✅ **FIXED** | Use `http://localhost:11434` (no `/v1`) | |
| 214 | + |
| 215 | +### Still Having Issues? |
| 216 | + |
| 217 | +```bash |
| 218 | +# Check if Ollama is running |
| 219 | +ollama list |
| 220 | + |
| 221 | +# Pull the model if needed |
| 222 | +ollama pull llama3.2:1b |
| 223 | + |
| 224 | +# Verify project setup |
| 225 | +pwd # Should show /path/to/your/project |
| 226 | +ls -la .super # Should show project config file |
| 227 | +``` |
| 228 | + |
| 229 | +--- |
| 230 | + |
| 231 | +## 📊 What You'll See |
| 232 | + |
| 233 | +### Successful Compilation |
| 234 | +``` |
| 235 | +✅ Agent 'optimas_crewai' compiled successfully! |
| 236 | +📁 Generated: agents/optimas_crewai/pipelines/optimas_crewai_optimas-crewai_pipeline.py |
| 237 | +🚀 Ready for evaluation and optimization! |
| 238 | +``` |
| 239 | + |
| 240 | +### Evaluation Results |
| 241 | +``` |
| 242 | +🧪 Evaluating agent 'optimas_crewai' with 8 scenarios... |
| 243 | +✅ basic_impl: PASSED |
| 244 | +✅ edge_case_empty_input: PASSED |
| 245 | +✅ parse_numbers: PASSED |
| 246 | +✅ string_ops: PASSED |
| 247 | +✅ error_handling: PASSED |
| 248 | +✅ data_structures: PASSED |
| 249 | +✅ algorithms: PASSED |
| 250 | +✅ file_operations: PASSED |
| 251 | +
|
| 252 | +🎉 All 8/8 scenarios passed! |
| 253 | +``` |
| 254 | + |
| 255 | +### Optimization Progress |
| 256 | +``` |
| 257 | +🚀 Optimizing agent 'optimas_crewai'... |
| 258 | +📊 OPRO: Iteration 1/3 |
| 259 | +🔍 Evaluating candidate prompt... |
| 260 | +📈 Score: 0.75 → 0.82 |
| 261 | +✅ Optimization complete! Best score: 0.82 |
| 262 | +``` |
| 263 | + |
| 264 | +--- |
| 265 | + |
| 266 | +## 🎯 Next Steps |
| 267 | + |
| 268 | +1. **Try different goals** - Test with various programming tasks |
| 269 | +2. **Experiment with models** - Test different Ollama models |
| 270 | +3. **Customize scenarios** - Add your own test cases |
| 271 | +4. **Build your own agent** - Create a custom playbook |
| 272 | +5. **Explore other targets** - Try OpenAI, AutoGen, or DSPy |
| 273 | + |
| 274 | +--- |
| 275 | + |
| 276 | +## 💡 Pro Tips |
| 277 | + |
| 278 | +- **Start with CrewAI target** - Most reliable for learning |
| 279 | +- **Use small models first** - Faster iteration during development |
| 280 | +- **Keep scenarios focused** - Test one thing at a time |
| 281 | +- **✅ Templates are fixed** - Pipelines now work correctly from the start |
| 282 | +- **✅ All targets functional** - 100% success rate across all frameworks |
| 283 | + |
| 284 | +**🎯 Ready to dive in?** Start with the Quick Demo above and then explore your favorite target! |
| 285 | + |
| 286 | + |
0 commit comments