Skip to content

Pull requests: vllm-project/production-stack

New pull request New
46 Open 424 Closed
46 Open 424 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

TTFT Routing
#670 opened Sep 1, 2025 by chickeyton • Draft
3 tasks
9
[Feat][PD] lastest PD support from LMCache with NIXL
#669 opened Aug 28, 2025 by kobe0938 Loading…
3 tasks
13
[Bug][Router] ZombieIP: router routes to model pod that doesn't exist anymore
#666 opened Aug 26, 2025 by jonoillar Loading…
3 tasks
1
22
[CI] Redeploy when running PD CI
#663 opened Aug 26, 2025 by zerofishnoodles Loading…
3 tasks done
1
[Build] use uv with cache mount for faster docker builds
#657 opened Aug 23, 2025 by Hexoplon Loading…
3 tasks done
3
[Feat][Router] add ability to specify params to drop
#650 opened Aug 20, 2025 by max-wittig Loading…
3 tasks done
5
[Feat][Router] Add simple request migration for vLLM failure
#643 opened Aug 12, 2025 by lucas-tucker Loading…
14
Add max_model_len field support to router
#638 opened Aug 11, 2025 by llm-net Loading…
4
[Router][Improvement] Enhanced Performance Configuration with uvicorn[standard] and uvloop Integration
#636 opened Aug 6, 2025 by ikaadil Loading…
3 tasks done
1
7
[CI/Build] Optimize Docker image size by excluding test and example files (#615)
#627 opened Aug 2, 2025 by ikaadil Loading…
3 tasks done
6
[Feat] Router-side queuing support
#626 opened Aug 2, 2025 by allytotheson Loading…
18
[Feat] Implement workflow-aware routing for multi-agent AI workflows
#625 opened Aug 2, 2025 by hongsw Loading…
6 tasks done
14
feat(helm): Use emptyDir as pvcStorage
#616 opened Jul 29, 2025 by Jimmy-Newtron Loading…
9
feat(utils): add vision model type
#603 opened Jul 24, 2025 by max-wittig • Draft
3 tasks
4
[Bugfix] Fix lora operator compatibility with other operator
#597 opened Jul 23, 2025 by zerofishnoodles • Draft
3 tasks done
10
resolve problem dynamic config
#591 opened Jul 21, 2025 by alikhabazian Loading…
3
[Feat] add api for speech and image
#567 opened Jul 4, 2025 by huiwq1990 Loading…
3 tasks done
6
[Router] Request Load Balancing, KVAware Router
#566 opened Jul 3, 2025 by allytotheson Loading…
13
[CI/Build] Stress tests on router with round-robin
#562 opened Jul 2, 2025 by kobe0938 Loading…
3 tasks
11
[Router] Request Time Tracking Router
#558 opened Jul 1, 2025 by allytotheson Loading…
@Shaoting-Feng
14
[Feat]: add transcriptions route
#542 opened Jun 26, 2025 by huiwq1990 Loading…
3 tasks done
8
[Router][Bugfix] make healthcheck timeout customizable
#538 opened Jun 25, 2025 by max-wittig • Draft
3 tasks done
4
[CI/Build] Use ADMIN_TOKEN in release workflow
#522 opened Jun 18, 2025 by zjw49246 Loading…
3 tasks done
@Shaoting-Feng
3
[Router and CI]: chat completions and update lmcache version
#484 opened Jun 4, 2025 by sammshen Loading…
3 tasks
[feat]: add transcription API endpoint using OpenAI Whisper-small
#469 opened May 30, 2025 by davidgao7 Loading…
3 of 5 tasks
56
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.