You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[Doc] Add container image save/load FAQ for offline environments (#2347)
### What this PR does / why we need it?
Add Docker export/import guide for air-gapped environments
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
NA
- vLLM version: v0.10.0
- vLLM main:
vllm-project/vllm@d16aa3d
Signed-off-by: QwertyJack <[email protected]>
If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access:
41
+
42
+
**Exporting Docker images:**
43
+
44
+
```{code-block} bash
45
+
:substitutions:
46
+
# Pull the image on a machine with internet access
47
+
TAG=|vllm_ascend_version|
48
+
docker pull quay.io/ascend/vllm-ascend:$TAG
49
+
50
+
# Export the image to a tar file and compress to tar.gz
51
+
docker save quay.io/ascend/vllm-ascend:$TAG | gzip > vllm-ascend-$TAG.tar.gz
52
+
```
53
+
54
+
**Importing Docker images in environment without internet access:**
55
+
56
+
```{code-block} bash
57
+
:substitutions:
58
+
# Transfer the tar/tar.gz file to the offline environment and load it
59
+
TAG=|vllm_ascend_version|
60
+
docker load -i vllm-ascend-$TAG.tar.gz
61
+
62
+
# Verify the image is loaded
63
+
docker images | grep vllm-ascend
64
+
```
65
+
39
66
### 3. What models does vllm-ascend supports?
40
67
41
68
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).
0 commit comments