Commit 3530a24
Implement dmrlet orchestrator for Docker Model Runner
- Add Cargo workspace with 8 crates
- dmrlet-core: Core types (Model, Worker, Endpoint, Config, Error, GPU)
- dmrlet-runtime: Process-based runtime for macOS/Windows
- dmrlet-scheduler: GPU-aware scheduler with placement logic
- dmrlet-network: Health checking, load balancing, service discovery
- dmrlet-store: Model cache with LRU eviction
- dmrlet-api: REST API server with Axum
- dmrlet-daemon: Main daemon binary (dmrletd)
- dmrlet-cli: CLI tool (dmrlet) with deploy, scale, delete, status commands
- Add proto file for future gRPC support
- Update .gitignore for Rust build artifacts
Co-authored-by: ericcurtin <1694275+ericcurtin@users.noreply.github.com>1 parent d192636 commit 3530a24
File tree
36 files changed
+6329
-0
lines changed- dmrlet
- crates
- dmrlet-api
- src
- dmrlet-cli
- src
- commands
- dmrlet-core
- src
- dmrlet-daemon
- src
- dmrlet-network
- src
- dmrlet-runtime
- src
- dmrlet-scheduler
- src
- dmrlet-store
- src
- proto
36 files changed
+6329
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
0 commit comments