Skip to content

Commit ee47fa3

Browse files
committed
Deployed 6189ef2 to 2.0 with MkDocs 1.6.0 and mike 2.1.3
1 parent 6189ef2 commit ee47fa3

File tree

5 files changed

+109
-94
lines changed

5 files changed

+109
-94
lines changed

2.0/installation/amd/installation/index.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3860,6 +3860,7 @@ <h2 id="installation">Installation</h2>
38603860
<div class="highlight"><pre><span></span><code>sudo<span class="w"> </span>docker<span class="w"> </span>run<span class="w"> </span>-d<span class="w"> </span>--name<span class="w"> </span>gpustack<span class="w"> </span><span class="se">\</span>
38613861
<span class="w"> </span>--restart<span class="w"> </span>unless-stopped<span class="w"> </span><span class="se">\</span>
38623862
<span class="w"> </span>--privileged<span class="w"> </span><span class="se">\</span>
3863+
<span class="w"> </span>--volume<span class="w"> </span>/opt/rocm:/opt/rocm:ro<span class="w"> </span><span class="se">\</span>
38633864
<span class="w"> </span>--network<span class="w"> </span>host<span class="w"> </span><span class="se">\</span>
38643865
<span class="w"> </span>--volume<span class="w"> </span>/var/run/docker.sock:/var/run/docker.sock<span class="w"> </span><span class="se">\</span>
38653866
<span class="w"> </span>--volume<span class="w"> </span>gpustack-data:/var/lib/gpustack<span class="w"> </span><span class="se">\</span>
@@ -3870,6 +3871,7 @@ <h2 id="installation">Installation</h2>
38703871
<li>The <code>--privileged</code> flag is required for device vendor-agnostic access.</li>
38713872
<li>To restrict GPU access, remove <code>--privileged</code> flag and set the <code>AMD_VISIBLE_DEVICES</code> environment variable.
38723873
See <a href="https://instinct.docs.amd.com/projects/container-toolkit/en/latest/container-runtime/migration-guide.html">AMD Container Runtime - Migration Guide</a>.</li>
3874+
<li>If the <code>/opt/rocm</code> directory does not exist, please create a symbolic link pointing to the ROCm installed path: <code>ln -s /path/to/rocm /opt/rocm</code>.</li>
38733875
<li>The <code>--network=host</code> option is necessary for port awareness.</li>
38743876
<li>Mounting <code>/var/run/docker.sock</code> allows GPUStack to manage Docker containers for inference engines.</li>
38753877
</ul>

2.0/installation/ascend/installation/index.html

Lines changed: 14 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3873,7 +3873,20 @@ <h2 id="installation">Installation</h2>
38733873
</code></pre></div>
38743874
<ul>
38753875
<li>To restrict NPU access, remove <code>--privileged</code> flag and set the <code>ASCEND_VISIBLE_DEVICES</code> environment variable.
3876-
See <a href="https://www.hiascend.com/document/detail/zh/mindcluster/72rc1/clustersched/dlug/dlruntime_ug_004.html">MindCluster - Docker Client Usage</a>.</li>
3876+
See <a href="https://www.hiascend.com/document/detail/zh/mindcluster/72rc1/clustersched/dlug/dlruntime_ug_004.html">MindCluster - Docker Client Usage</a>.
3877+
When GPUStack detects device indexes that don't start from 0 or are not consecutive, it performs automatic alignment.
3878+
This is useful for virtual machine scenarios where only some devices are pass-through.
3879+
However, if the host's devices are consecutive, automatic alignment can be counterproductive.
3880+
Therefore, automatic alignment can be turned off to avoid wrong device mapping.</li>
3881+
</ul>
3882+
<div class="highlight"><pre><span></span><code><span class="w"> </span>sudo docker run -d --name gpustack \
3883+
<span class="w"> </span> ...
3884+
<span class="gd">- --privileged \</span>
3885+
<span class="gi">+ --env &quot;ASCEND_VISIBLE_DEVICES=&lt;expected_devices_comma_seperated_list&gt;&quot; \</span>
3886+
<span class="gi">+ --env &quot;GPUSTACK_RUNTIME_DEPLOY_BACKEND_VISIBLE_DEVICES_VALUE_ALIGNMENT=&quot; \</span>
3887+
<span class="w"> </span> ...
3888+
</code></pre></div>
3889+
<ul>
38773890
<li>The <code>--network=host</code> option is necessary for port awareness.</li>
38783891
<li>Mounting <code>/var/run/docker.sock</code> allows GPUStack to manage Docker containers for inference engines.</li>
38793892
</ul>

2.0/search/search_index.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)