Skip to content

Commit 30b6710

Browse files
committed
edits
1 parent 5954c08 commit 30b6710

File tree

1 file changed

+7
-22
lines changed

1 file changed

+7
-22
lines changed

content/manuals/desktop/features/model-runner.md

Lines changed: 7 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,12 @@ keywords: Docker, ai, model runner, docker deskotp,
1414

1515
The Docker Model Runner plugin lets you:
1616

17-
- Run AI models directly from the command line
1817
- Pull models from Docker Hub
19-
- Manage local models (list, remove)
18+
- Run AI models directly from the command line
19+
- Manage local models (add, list, remove)
2020
- Interact with models in prompt or chat mode
2121

22-
Models are pulled from Docker Hub and then loaded dynamically into memory based on request usage.
23-
The first pull may take a while; after that, model files are cached locally. You can interact with the model using [OpenAI-compatible APIs](#what-api-endpoints-are-available).
22+
Models are pulled from Docker Hub the first time they're used and stored locally. They're loaded into memory only at runtime when a request is made, and unloaded when not in use to optimize resources. Since models can be large, the initial pull may take some time — but after that, they're cached locally for faster access. You can interact with the model using [OpenAI-compatible APIs](#what-api-endpoints-are-available).
2423

2524
## Enable the feature
2625

@@ -92,25 +91,11 @@ Lists all models currently pulled to your local environment.
9291
$ docker model list
9392
```
9493

95-
If no models have been pulled yet, you will see:
96-
97-
```json
98-
{"object":"list","data":[]}
99-
```
100-
101-
For better readability, format the output using `jq`:
94+
If no models have been pulled yet, you will something similar to:
10295

103-
```console
104-
$ docker model list | jq .
105-
```
106-
107-
Expected formatted output:
108-
109-
```json
110-
{
111-
"object": "list",
112-
"data": []
113-
}
96+
```text
97+
MODEL PARAMETERS QUANTIZATION ARCHITECTURE MODEL ID CREATED SIZE
98+
ignaciolopezluna020/gemma-3-it:4B-Q4_K_M 3.88 B IQ2_XXS/Q4_K_M gemma3 adea14bef2fe 55 years ago 2.31 GiB
11499
```
115100

116101
### Run a model

0 commit comments

Comments
 (0)