You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Notes: For this small dataset, demos neither help nor hurt. Seed demos from your real tasks for measurable gains.
138
+
Notes: For this small dataset, demos neither help nor hurt. For larger flows, compile demos from your real tasks.
139
+
140
+
### Cost & Tokens
141
+
- The agent aggregates token counts and cost (when available). If provider usage isn’t exposed, it estimates tokens from prompts/outputs and computes cost using env prices.
142
+
- Set env prices for OpenAI models (USD per 1K tokens):
143
+
```bash
144
+
export OPENAI_INPUT_PRICE_PER_1K=0.005 # example
145
+
export OPENAI_OUTPUT_PRICE_PER_1K=0.015 # example
146
+
```
147
+
The eval script will include `avg_cost_usd`. Defaults to 0 if prices aren’t set.
139
148
140
149
## Optimize (Teleprompting)
141
150
- Compile optimized few-shot demos for the OpenAI `PlanWithTools` planner and save to JSON:
0 commit comments