Skip to content

Commit 3166e7e

Browse files
Add example usage
1 parent 5557c5e commit 3166e7e

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

optillm/cepo/README.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,19 @@ The model reviews all generated solution proposals and their associated plans, i
2323
**Step 4**: Final Solution
2424
The model uses the refined plan from Step 3 to produce the final answer.
2525

26+
## Example Usage
27+
28+
Here’s an example of running Optillm using the CePO method for Qwen3 deployed with VLLM on port 8001:
29+
30+
```bash
31+
OPENAI_API_KEY=serving-on-vllm \
32+
python optillm.py \
33+
--base-url http://localhost:8001/v1 \
34+
--approach cepo \
35+
--port 8000 \
36+
--cepo_config_file ./optillm/cepo/cepo_configs/cepo_qwen3.yaml
37+
```
38+
2639
## CePO Current Status
2740

2841
This project is a work in progress, and the provided code is in an early experimental stage. While the proposed approach works well across the benchmarks we tested, further improvements can be achieved by task-specific customizations to prompts.

0 commit comments

Comments
 (0)