Commit 1aa4640
committed
[Config Refactor][1/N] Two-Tier Stage Configuration & Independent Stage Launch
Introduce a two-tier configuration system separating internal pipeline
topology (Tier-1) from user-configurable runtime params (Tier-2).
Tier-1 (Pipeline Topology):
- StageConfig dataclass with typed fields for stage identity, DAG
connections, worker types, and processing hooks
- StageTopology with validate_topology() for integration-time checks
- Clean YAML files in stage_topologies/ (no runtime params)
Tier-2 (Runtime Config):
- StageConfigFactory merges CLI overrides into stage configs
- Blocklist approach: all engine-registered CLI args forwarded unless
in _INTERNAL_KEYS (no hardcoded allowlist to maintain)
- Per-stage overrides via --stage-N-* prefix convention
- auto_allocate_memory() for shared-device memory splitting
Other changes:
- OmegaConf isolated in yaml_util.py (5 wrapper functions)
- --stage-id CLI arg for independent stage launch
- 34 unit tests across 8 categories
- Fix UnboundLocalError in get_final_stage_id_for_e2e
- Deprecation docstrings on legacy OmegaConf loading paths
Signed-off-by: lishunyang <lishunyang12@163.com>1 parent a3f2d4c commit 1aa4640
File tree
15 files changed
+1671
-52
lines changed- examples/offline_inference/qwen3_omni
- tests
- vllm_omni
- config
- entrypoints
- cli
- model_executor/stage_topologies
15 files changed
+1671
-52
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| 24 | + | |
24 | 25 | | |
25 | 26 | | |
26 | 27 | | |
| |||
294 | 295 | | |
295 | 296 | | |
296 | 297 | | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
297 | 319 | | |
298 | 320 | | |
299 | | - | |
300 | | - | |
301 | | - | |
| 321 | + | |
302 | 322 | | |
303 | 323 | | |
304 | 324 | | |
| |||
458 | 478 | | |
459 | 479 | | |
460 | 480 | | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
461 | 487 | | |
462 | 488 | | |
463 | 489 | | |
| |||
474 | 500 | | |
475 | 501 | | |
476 | 502 | | |
477 | | - | |
| 503 | + | |
| 504 | + | |
| 505 | + | |
| 506 | + | |
| 507 | + | |
| 508 | + | |
| 509 | + | |
| 510 | + | |
| 511 | + | |
| 512 | + | |
| 513 | + | |
| 514 | + | |
| 515 | + | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
| 523 | + | |
| 524 | + | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
| 528 | + | |
| 529 | + | |
| 530 | + | |
| 531 | + | |
| 532 | + | |
| 533 | + | |
| 534 | + | |
| 535 | + | |
| 536 | + | |
| 537 | + | |
| 538 | + | |
| 539 | + | |
| 540 | + | |
478 | 541 | | |
479 | 542 | | |
480 | 543 | | |
| |||
0 commit comments