Skip to content

Commit f19e4e8

Browse files
author
AWS
committed
Amazon SageMaker Service Update: This release introduces compute quota for GPU, Trainium accelerators, vCPU, and vCPU memory utilization across teams in HyperPod clusters
1 parent 8621d69 commit f19e4e8

File tree

2 files changed

+36
-0
lines changed

2 files changed

+36
-0
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"type": "feature",
3+
"category": "Amazon SageMaker Service",
4+
"contributor": "",
5+
"description": "This release introduces compute quota for GPU, Trainium accelerators, vCPU, and vCPU memory utilization across teams in HyperPod clusters"
6+
}

services/sagemaker/src/main/resources/codegen-resources/service-2.json

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4561,6 +4561,12 @@
45614561
}
45624562
},
45634563
"shapes":{
4564+
"AcceleratorsAmount":{
4565+
"type":"integer",
4566+
"box":true,
4567+
"max":10000000,
4568+
"min":0
4569+
},
45644570
"Accept":{
45654571
"type":"string",
45664572
"max":256,
@@ -9645,6 +9651,18 @@
96459651
"Count":{
96469652
"shape":"InstanceCount",
96479653
"documentation":"<p>The number of instances to add to the instance group of a SageMaker HyperPod cluster.</p>"
9654+
},
9655+
"Accelerators":{
9656+
"shape":"AcceleratorsAmount",
9657+
"documentation":"<p>The number of accelerators to allocate. If you don't specify a value for vCPU and MemoryInGiB, SageMaker AI automatically allocates ratio-based values for those parameters based on the number of accelerators you provide. For example, if you allocate 16 out of 32 total accelerators, SageMaker AI uses the ratio of 0.5 and allocates values to vCPU and MemoryInGiB.</p>"
9658+
},
9659+
"VCpu":{
9660+
"shape":"VCpuAmount",
9661+
"documentation":"<p>The number of vCPU to allocate. If you specify a value only for vCPU, SageMaker AI automatically allocates ratio-based values for MemoryInGiB based on this vCPU parameter. For example, if you allocate 20 out of 40 total vCPU, SageMaker AI uses the ratio of 0.5 and allocates values to MemoryInGiB. Accelerators are set to 0.</p>"
9662+
},
9663+
"MemoryInGiB":{
9664+
"shape":"MemoryInGiBAmount",
9665+
"documentation":"<p>The amount of memory in GiB to allocate. If you specify a value only for this parameter, SageMaker AI automatically allocates a ratio-based value for vCPU based on this memory that you provide. For example, if you allocate 200 out of 400 total memory in GiB, SageMaker AI uses the ratio of 0.5 and allocates values to vCPU. Accelerators are set to 0.</p>"
96489666
}
96499667
},
96509668
"documentation":"<p>Configuration of the resources used for the compute allocation definition.</p>"
@@ -30769,6 +30787,12 @@
3076930787
"max":10,
3077030788
"min":1
3077130789
},
30790+
"MemoryInGiBAmount":{
30791+
"type":"float",
30792+
"box":true,
30793+
"max":10000000,
30794+
"min":0
30795+
},
3077230796
"MemoryInMb":{
3077330797
"type":"integer",
3077430798
"box":true,
@@ -45251,6 +45275,12 @@
4525145275
"max":100,
4525245276
"min":1
4525345277
},
45278+
"VCpuAmount":{
45279+
"type":"float",
45280+
"box":true,
45281+
"max":10000000,
45282+
"min":0
45283+
},
4525445284
"ValidationFraction":{
4525545285
"type":"float",
4525645286
"box":true,

0 commit comments

Comments
 (0)