You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The environment variable [`MUSA_VISIBLE_DEVICES`](https://docs.mthreads.com/musa-sdk/musa-sdk-doc-online/programming_guide/Z%E9%99%84%E5%BD%95/) can be used to specify which GPU(s) will be used.
210
217
211
218
The environment variable `GGML_CUDA_ENABLE_UNIFIED_MEMORY=1` can be used to enable unified memory in Linux. This allows swapping to system RAM instead of crashing when the GPU VRAM is exhausted.
212
219
213
220
Most of the compilation options available for CUDA should also be available for MUSA, though they haven't been thoroughly tested yet.
214
221
222
+
215
223
## HIP
216
224
217
225
This provides GPU acceleration on HIP-supported AMD GPUs.
0 commit comments