Skip to content

Commit 8bfd16a

Browse files
authored
[Doc] Add container image save/load FAQ for offline environments (#2347)
### What this PR does / why we need it? Add Docker export/import guide for air-gapped environments ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? NA - vLLM version: v0.10.0 - vLLM main: vllm-project/vllm@d16aa3d Signed-off-by: QwertyJack <[email protected]>
1 parent 992271b commit 8bfd16a

File tree

1 file changed

+27
-0
lines changed

1 file changed

+27
-0
lines changed

docs/source/faqs.md

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,33 @@ TAG=v0.7.3rc2
3636
docker pull m.daocloud.io/quay.io/ascend/vllm-ascend:$TAG
3737
```
3838

39+
#### Load Docker Images for offline environment
40+
If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access:
41+
42+
**Exporting Docker images:**
43+
44+
```{code-block} bash
45+
:substitutions:
46+
# Pull the image on a machine with internet access
47+
TAG=|vllm_ascend_version|
48+
docker pull quay.io/ascend/vllm-ascend:$TAG
49+
50+
# Export the image to a tar file and compress to tar.gz
51+
docker save quay.io/ascend/vllm-ascend:$TAG | gzip > vllm-ascend-$TAG.tar.gz
52+
```
53+
54+
**Importing Docker images in environment without internet access:**
55+
56+
```{code-block} bash
57+
:substitutions:
58+
# Transfer the tar/tar.gz file to the offline environment and load it
59+
TAG=|vllm_ascend_version|
60+
docker load -i vllm-ascend-$TAG.tar.gz
61+
62+
# Verify the image is loaded
63+
docker images | grep vllm-ascend
64+
```
65+
3966
### 3. What models does vllm-ascend supports?
4067

4168
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).

0 commit comments

Comments
 (0)