Add model manager that automatically allocate models and prevents OOMs #37103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft

AMOOOMA wants to merge 50 commits into apache:master from AMOOOMA:model

Draft

Add model manager that automatically allocate models and prevents OOMs #37103

Merge branch 'apache:master' into model

GitHub Actions / Python 3.13 Test Results (self-hosted, ubuntu-20.04, main) completed Dec 15, 2025 in 0s

No tests found

0 tests ±0 0 ✅ ±0 0s ⏱️ ±0s
0 suites ±0 0 💤 ±0
0 files ±0 0 ❌ ±0

Results for commit 970ecf5. ± Comparison against earlier commit 1d3f8c9.

View more details on GitHub Actions