Commit c4ef389
Add comment explaining max_batch_size assumption in bagel.yaml
Stage-0 max_batch_size=2 assumes single-prompt inference (1 user + 1
CFG companion). For multi-prompt batches it should scale accordingly.
Co-authored-by: Cursor <cursoragent@cursor.com>1 parent 5ad0b4e commit c4ef389
1 file changed
+2
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| 9 | + | |
| 10 | + | |
9 | 11 | | |
10 | 12 | | |
11 | 13 | | |
| |||
0 commit comments