@@ -127,7 +127,8 @@ LLaMA Box supports the following platforms.
127127| -----------------------------------------------------| ---------------------------------------------------------------------------------------------------------------------------------------| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
128128| ** NVIDIA CUDA < br/> 12.8 (12.8.0)** | ` linux/amd64` < sup> RockyLinux 8.9< /sup><br/> ` linux/arm64` < sup> RockyLinux 8.9< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | [Compute capability](https://developer.nvidia.com/cuda-gpus) matches: < br/> ` 6.0` , ` 6.1` , < br/> ` 7.0` , ` 7.5` , < br/> ` 8.0` , ` 8.6` , ` 8.7` , ` 8.9` < br/> ` 9.0` , < br/> ` 10.0` , ` 10.1` , < br/> ` 12.0` . < br/> [Driver version](https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#id4) requires: < br/> ` > =525.60.13(linux)` < br/> ` > =528.33(windows)` . |
129129| ** NVIDIA CUDA < br/> 12.4 (12.4.0)** | ` linux/amd64` < sup> CentOS 7< /sup><br/> ` linux/arm64` < sup> RockyLinux 8.9< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | [Compute capability](https://developer.nvidia.com/cuda-gpus) matches: < br/> ` 6.0` , ` 6.1` , < br/> ` 7.0` , ` 7.5` , < br/> ` 8.0` , ` 8.6` , ` 8.7` , ` 8.9` < br/> ` 9.0` . < br/> [Driver version](https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#id4) requires: < br/> ` > =525.60.13(linux)` < br/> ` > =528.33(windows)` . |
130- | ** AMD ROCm/HIP < br/> 6.2 (6.2.4)** | ` linux/amd64` < sup> CentOS 7< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | LLVM target matches: < br/> ` gfx906 (linux)` , < br/> ` gfx908 (linux)` , < br/> ` gfx90a (linux)` , < br/> ` gfx942 (linux)` , < br/> ` gfx1030` , ` gfx1031` , ` gfx1032` , < br/> ` gfx1100` , ` gfx1101` , ` gfx1102` , < br/> see [Linux Installation](https://rocm.docs.amd.com/projects/install-on-linux/en/docs-6.2.4/reference/system-requirements.html), < br/> [Windows Installation](https://rocm.docs.amd.com/projects/install-on-windows/en/docs-6.2.4/reference/system-requirements.html). |
130+ | ** AMD ROCm/HIP < br/> 6.2 (6.2.4)** | ` linux/amd64` < sup> CentOS 7< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | LLVM target matches: < br/> ` gfx906` , < br/> ` gfx908` , < br/> ` gfx90a` , < br/> ` gfx942` , < br/> ` gfx1030` , ` gfx1031` , ` gfx1032` , ` gfx1033` , < br/> ` gfx1100` , ` gfx1101` , ` gfx1102` , < br/> ` gfx1150` , ` gfx1151` , < br/> see [Linux Installation](https://rocm.docs.amd.com/projects/install-on-linux/en/docs-6.4.2/reference/system-requirements.html). |
131+ | ** AMD ROCm/HIP < br/> 6.4 (6.4.2)** | ` linux/amd64` < sup> Ubuntu 22.04< /sup><br/> | LLVM target matches: < br/> ` gfx906 (linux)` , < br/> ` gfx908 (linux)` , < br/> ` gfx90a (linux)` , < br/> ` gfx942 (linux)` , < br/> ` gfx1030` , ` gfx1031` , ` gfx1032` , < br/> ` gfx1100` , ` gfx1101` , ` gfx1102` , < br/> see [Linux Installation](https://rocm.docs.amd.com/projects/install-on-linux/en/docs-6.2.4/reference/system-requirements.html), < br/> [Windows Installation](https://rocm.docs.amd.com/projects/install-on-windows/en/docs-6.2.4/reference/system-requirements.html). |
131132| ** Intel oneAPI < br/> 2025.0 (2025.0.0)** | ` linux/amd64` < sup> Ubuntu 22.04< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | Support [Intel oneAPI](https://en.wikipedia.org/wiki/OneAPI_(compute_acceleration)), < br/> see [Toolkit Requirements](https://www.intel.com/content/www/us/en/developer/articles/system-requirements/intel-oneapi-base-toolkit-system-requirements.html). |
132133| ** LunarG Vulkan < br/> 1.4 (1.4.313)** | ` linux/amd64` < sup> Ubuntu 22.04< /sup><br/> ` windows/amd64` < sup> Windows Server 2022< /sup> | Support [LunarG Vulkan](https://vulkan.lunarg.com/), < br/> check [Support Devices](https://vulkan.gpuinfo.org/listdevices.php). |
133134| ** Huawei Ascend CANN < br/> 8.2.rc1 (8.2.rc1)** | ` linux/amd64` < sup> Ubuntu 20.04< /sup><br/> ` linux/arm64` < sup> Ubuntu 20.04< /sup> | ` Ascend 910b` , ` Ascend 310p` , < br/> see [Ascend Document](https://www.hiascend.com/en/document). |
0 commit comments