You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: harbor pull smart routing, volumes CLI, and down resilience
- harbor pull delegates to run_models_pull for HF metadata-based
routing (GGUF -> llamacpp, other -> hf download) instead of
hardcoding llamacpp for all HuggingFace repos
- harbor down stops host services (MLX, DMR) before compose down
so they are cleaned up even when Docker is unavailable
- Add harbor volumes CLI and help text
- Rewrite MLX CLI functions for mlx-lm, remove mlx-serve references
- Extract config search/list to configSearch routine
- Update README and install docs for DMR/MLX backends
Harbor supports most of the major inference engines as well as a few of the lesser-known ones.
104
+
Harbor supports most of the major inference engines as well as a few of the lesser-known ones. On macOS, [Docker Model Runner](./docs/2.2.22-Backend-Docker-Model-Runner.md) and [MLX](./docs/2.2.23-Backend-MLX.md) run inference on the host with Metal acceleration — no containers needed for the compute.
101
105
102
106
```bash
103
107
# We sincerely hope you'll never try to run all of them at once
Copy file name to clipboardExpand all lines: docs/1.0.-Installing-Harbor.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -186,7 +186,7 @@ Follow the [Harbor CLI installation methods](#harbor-cli-installation-methods) b
186
186
- Administrator access
187
187
188
188
> [!NOTE]
189
-
> **ARM64 Limitation:** Some services don't ship ARM64 images (Apple Silicon). GPU pass-through is not supported on macOS.
189
+
> **ARM64 Limitation:** Some services don't ship ARM64 images (Apple Silicon). GPU pass-through is not supported on macOS. For Metal-accelerated inference, use host-native backends like [Docker Model Runner](./2.2.22-Backend-Docker-Model-Runner.md) (`harbor up dmr`) or [MLX](./2.2.23-Backend-MLX.md) (`harbor up mlx`) — they run on the host and are exposed to Harbor containers via a proxy.
0 commit comments