Skip to content

Commit 3530a24

Browse files
Copilotericcurtin
andcommitted
Implement dmrlet orchestrator for Docker Model Runner
- Add Cargo workspace with 8 crates - dmrlet-core: Core types (Model, Worker, Endpoint, Config, Error, GPU) - dmrlet-runtime: Process-based runtime for macOS/Windows - dmrlet-scheduler: GPU-aware scheduler with placement logic - dmrlet-network: Health checking, load balancing, service discovery - dmrlet-store: Model cache with LRU eviction - dmrlet-api: REST API server with Axum - dmrlet-daemon: Main daemon binary (dmrletd) - dmrlet-cli: CLI tool (dmrlet) with deploy, scale, delete, status commands - Add proto file for future gRPC support - Update .gitignore for Rust build artifacts Co-authored-by: ericcurtin <1694275+ericcurtin@users.noreply.github.com>
1 parent d192636 commit 3530a24

File tree

36 files changed

+6329
-0
lines changed

36 files changed

+6329
-0
lines changed

.gitignore

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,3 +12,7 @@ llamacpp/build
1212
llamacpp/install
1313

1414
.DS_Store
15+
16+
# Rust build artifacts
17+
dmrlet/target/
18+
*.rs.bk

0 commit comments

Comments
 (0)