Skip to content

Commit 46a8a4a

Browse files
sjjamsasjjamsa
committed
Update gpu list
1 parent 5975fbd commit 46a8a4a

File tree

2 files changed

+6
-9
lines changed

2 files changed

+6
-9
lines changed

‎triton/ref/gpu.rst‎

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,6 @@
33
:header-rows: 1
44

55
Card | Slurm partition (``--partition=``) | Slurm feature name (``--constraint=``) | Slurm gres name (``--gres=gpu:NAME:n``) | total amount | nodes | architecture | compute threads per GPU | memory per card | CUDA compute capability
6-
NVIDIA K80\* | *Not available* | ``kepler`` | ``teslak80`` | 12 | gpu[20-22] | Kepler | 2x2496 | 2x12GB | 3.7
7-
NVIDIA P100 | ``gpu-p100-16g`` | ``pascal`` | ``teslap100`` | 20 | gpu[23-27] | Pascal | 3854 | 16GB | 6.0
86
NVIDIA V100 | ``gpu-v100-32g`` | ``volta`` | ``v100`` | 40 | gpu[1-10] | Volta | 5120 | 32GB | 7.0
97
NVIDIA V100 | ``gpu-v100-32g`` | ``volta`` | ``v100`` | 40 | gpu[28-37] | Volta | 5120 | 32GB | 7.0
108
NVIDIA V100 | ``gpu-v100-16g`` | ``volta`` | ``v100`` | 176 | dgx[1-2,8-27]| Volta | 5120 | 16GB | 7.0
@@ -13,7 +11,8 @@
1311
NVIDIA H100 | ``gpu-h100-80g`` | ``hopper`` | ``h100`` | 16 | gpu[45-48] | Hopper | 16896 | 80GB | 9.0
1412
NVIDIA H200 | ``gpu-h200-18g-ia`` | ``hopper`` | ``h200-18g`` | 56 | gpu[49] | Hopper | | 18GB | 9.0
1513
NVIDIA H200(*) | ``gpu-h200-141g-ellis``, ``gpu-h200-141g-short`` | ``hopper`` | ``h200`` | 112 | gpu[50-63] | Hopper | | 141GB | 9.0
16-
AMD MI100 (testing) | *Not yet installed* | ``mi100`` | Use ``-p gpu-amd`` only, no ``--gres`` | | gpuamd[1] | | | |
14+
AMD MI100 | ``gpu-amd`` | features not supported | ``-p gpu-amd --gres=gpu:mi100`` | 1 | gpuamd[1] | | | |
15+
AMD MI210 | ``gpu-amd`` | features not supported | ``-p gpu-amd --gres=gpu:mi210`` | 2 | gpuamd[1] | | | |
1716

1817
(*) These GPUs have a priority queue for the ellis project, since they were procured for this project.
1918
Any job submitted to the short queue might be preempted if a job requiring the resources comes in from the ellis queue.

‎triton/ref/hardware.rst‎

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -12,12 +12,10 @@
1212
fn3 | 1 | Dell PowerEdge R940 | 2020 | avx2 avx512 | 4x20 core `Xeon Gold 6148 <https://ark.intel.com/products/120489>`__ 2.40GHz | 2TB DDR4-2666 | EDR | | No disk
1313
gpu[1-10] | 10 | Dell PowerEdge C4140 | 2020 | skl avx2 avx512 volta | 2x8 core Intel Xeon Gold 6134 @ 3.2GHz | 384GB DDR4-2667 | EDR | 4x `V100 <https://www.nvidia.com/en-us/data-center/tesla-v100>`__ 32GB | 1.5 TB SSD
1414
gpu[11-17,38-44] | 14 | Dell PowerEdge XE8545 | 2021, 2023| milan avx2 ampere a100 | 2x24 core AMD EPYC 7413 @ 2.65GHz | 503GB DDR4-3200 | EDR | 4x `A100 <https://www.nvidia.com/en-us/data-center/a100/>`__ 80GB | 440 GB SSD
15-
gpu[20-22] | 3 | Dell PowerEdge C4130 | 2016 | hsw avx2 kepler | 2x6 core `Xeon E5 2620 v3 <https://ark.intel.com/products/83352/Intel-Xeon-Processor-E5-2620-v3-15M-Cache-2_40-GHz>`__ 2.50GHz | 128GB DDR4-2133 | EDR | 4x2 GPU `K80 <https://www.nvidia.com/en-gb/data-center/tesla-k80/>`__ | 440 GB SSD
16-
gpu[23-27] | 5 | Dell PowerEdge C4130 | 2017 | hsw avx2 pascal | 2x12 core Xeon E5-2680 v3 @ 2.5GHz | 256GB DDR4-2400 | EDR | 4x `P100 <https://www.nvidia.com/object/tesla-p100.html>`__ | 720 GB SSD
1715
gpu[28-37] | 10 | Dell PowerEdge C4140 | 2019 | skl avx2 avx512 volta | 2x8 core Intel Xeon Gold 6134 @ 3.2GHz | 384GB DDR4-2667 | EDR | 4x `V100 <https://www.nvidia.com/en-us/data-center/v100/>`__ 32GB | 1.5 TB SSD
18-
dgx[1-2,8-27] | 22 | Nvidia DGX-1 | 2018, 2025| bdw avx2 volta | 2x20 core `Xeon E5-2698 v4 @ 2.2GHz <https://ark.intel.com/products/91753/Intel-Xeon-Processor-E5-2698-v4-50M-Cache-2_20-GHz>`__ | 512GB DDR4-2133 | EDR | 8x `V100 <https://www.nvidia.com/en-us/data-center/v100/>`__ 16GB | 7 TB SSD
16+
dgx[1-2,8-27] | 22 | Nvidia DGX-1 | 2018, 2025| bdw avx2 volta | 2x20 core `Xeon E5-2698 v4 @ 2.2GHz <https://ark.intel.com/products/91753/Intel-Xeon-Processor-E5-2698-v4-50M-Cache-2_20-GHz>`__ | 512GB DDR4-2133 | EDR | 8x `V100 <https://www.nvidia.com/en-us/data-center/v100/>`__ 16GB | 7 TB SSD
1917
dgx[3,5-7] | 4 | Nvidia DGX-1 | 2018 | bdw avx2 volta | 2x20 core `Xeon E5-2698 v4 @ 2.2GHz <https://ark.intel.com/products/91753/Intel-Xeon-Processor-E5-2698-v4-50M-Cache-2_20-GHz>`__ | 512GB DDR4-2133 | EDR | 8x `V100 <https://www.nvidia.com/en-us/data-center/v100/>`__ 32GB| 7 TB SSD
20-
gpuamd1 | 1 | Dell PowerEdge R7525 | 2021 | rome avx2 mi100 | 2x8 core AMD EPYC 7262 @3.2GHz | 250GB DDR4-3200 | EDR | 3x `MI100 <https://www.amd.com/en/products/server-accelerators/instinct-mi100>`__ | 32GB SSD
18+
gpuamd1 | 1 | Dell PowerEdge R7525 | 2021 | rome avx2 mi100 | 2x8 core AMD EPYC 7262 @3.2GHz | 250GB DDR4-3200 1 | EDR | 2x `MI210 <https://www.amd.com/en/products/accelerators/instinct/mi200/mi210.html>`__, 1x `MI100 <https://www.amd.com/en/products/accelerators/instinct/mi100.html>`__ | 32GB SSD
2119
gpu[45-48] | 4 | Dell PowerEdge XE8640 | 2024 | saphr avx2 h100 hopper | 2x48 core `Xeon Platinum 8468 <https://www.intel.com/content/www/us/en/products/sku/231735/intel-xeon-platinum-8468-processor-105m-cache-2-10-ghz/specifications.html>`__ 2.1GHz | 1024GB DDR5-4800 | HDR | 4x `H100 SXM <https://www.nvidia.com/en-us/data-center/h100/>`__ 80GB | 21 TB SSD
22-
gpu[49] | 1 | Dell PowerEdge XE9680 | 2024 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ each split to 7x18GB | 20 TB SSD
23-
gpu[50-63] | 14 | Dell PowerEdge XE9680 | 2024 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ 141GB | 20 TB SSD
20+
gpu[49] | 1 | Dell PowerEdge XE9680 | 2025 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ each split to 7x18GB | 20 TB SSD
21+
gpu[50-63] | 14 | Dell PowerEdge XE9680 | 2025 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ 141GB | 20 TB SSD

0 commit comments

Comments
 (0)