Skip to content

Commit 1280294

Browse files
atobiszeidtrawins
andauthored
Update README.md (#3757)
### 🛠 Summary Fix procedure for benchmarking performance ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices. `` --------- Co-authored-by: Trawinski, Dariusz <[email protected]>
1 parent df9c4b3 commit 1280294

File tree

1 file changed

+2
-0
lines changed
  • demos/continuous_batching/agentic_ai

1 file changed

+2
-0
lines changed

demos/continuous_batching/agentic_ai/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -488,6 +488,8 @@ To simulate such type of load, we should use a dedicated tool [multi_turn benchm
488488
```bash
489489
git clone -b v0.10.2 https://github.com/vllm-project/vllm
490490
cd vllm/benchmarks/multi_turn
491+
wget https://www.gutenberg.org/ebooks/1184.txt.utf-8
492+
mv 1184.txt.utf-8 pg1184.txt
491493
pip install -r requirements.txt
492494
sed -i -e 's/if not os.path.exists(args.model)/if 1 == 0/g' benchmark_serving_multi_turn.py
493495
# Testing single client scenario, for example with GPU execution

0 commit comments

Comments
 (0)