Skip to content

Commit a558d8e

Browse files
authored
KFLUXINFRA-2015: Enable newer arm64 instance types (m7g+) (#7409)
Add large disk instances of the latest arm64 and amd64 instance types available in AWS. These instance types support newer cpu features required to build and test vllm. And the higher network and disk performance will accelerate the very resource-intensive vllm builds. Signed-off-by: Mike Bonnet <[email protected]>
1 parent 64d8861 commit a558d8e

File tree

1 file changed

+28
-0
lines changed

1 file changed

+28
-0
lines changed

components/multi-platform-controller/production/kflux-prd-rh03/host-config.yaml

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,8 @@ data:
2626
linux-m4xlarge/arm64,\
2727
linux-m8xlarge/amd64,\
2828
linux-m8xlarge/arm64,\
29+
linux-d160-m8-8xlarge/arm64,\
30+
linux-d160-m7-8xlarge/amd64,\
2931
linux-c6gd2xlarge/arm64,\
3032
linux-cxlarge/amd64,\
3133
linux-cxlarge/arm64,\
@@ -140,6 +142,19 @@ data:
140142
dynamic.linux-m8xlarge-arm64.max-instances: "5"
141143
dynamic.linux-m8xlarge-arm64.subnet-id: subnet-0263af86f44821eac
142144

145+
dynamic.linux-d160-m8-8xlarge-arm64.type: aws
146+
dynamic.linux-d160-m8-8xlarge-arm64.region: us-east-1
147+
dynamic.linux-d160-m8-8xlarge-arm64.ami: ami-03d6a5256a46c9feb
148+
dynamic.linux-d160-m8-8xlarge-arm64.instance-type: m8g.8xlarge
149+
dynamic.linux-d160-m8-8xlarge-arm64.instance-tag: prod-arm64-m8-8xlarge-d160
150+
dynamic.linux-d160-m8-8xlarge-arm64.key-name: kflux-prd-rh03-key-pair
151+
dynamic.linux-d160-m8-8xlarge-arm64.aws-secret: aws-account
152+
dynamic.linux-d160-m8-8xlarge-arm64.ssh-secret: aws-ssh-key
153+
dynamic.linux-d160-m8-8xlarge-arm64.security-group-id: sg-0759f4a43faada557
154+
dynamic.linux-d160-m8-8xlarge-arm64.max-instances: "5"
155+
dynamic.linux-d160-m8-8xlarge-arm64.subnet-id: subnet-0263af86f44821eac
156+
dynamic.linux-d160-m8-8xlarge-arm64.disk: "160"
157+
143158
dynamic.linux-c6gd2xlarge-arm64.type: aws
144159
dynamic.linux-c6gd2xlarge-arm64.region: us-east-1
145160
dynamic.linux-c6gd2xlarge-arm64.ami: ami-03d6a5256a46c9feb
@@ -301,6 +316,19 @@ data:
301316
dynamic.linux-m8xlarge-amd64.max-instances: "5"
302317
dynamic.linux-m8xlarge-amd64.subnet-id: subnet-0263af86f44821eac
303318

319+
dynamic.linux-d160-m7-8xlarge-amd64.type: aws
320+
dynamic.linux-d160-m7-8xlarge-amd64.region: us-east-1
321+
dynamic.linux-d160-m7-8xlarge-amd64.ami: ami-026ebd4cfe2c043b2
322+
dynamic.linux-d160-m7-8xlarge-amd64.instance-type: m7a.8xlarge
323+
dynamic.linux-d160-m7-8xlarge-amd64.instance-tag: prod-amd64-m7-8xlarge-d160
324+
dynamic.linux-d160-m7-8xlarge-amd64.key-name: kflux-prd-rh03-key-pair
325+
dynamic.linux-d160-m7-8xlarge-amd64.aws-secret: aws-account
326+
dynamic.linux-d160-m7-8xlarge-amd64.ssh-secret: aws-ssh-key
327+
dynamic.linux-d160-m7-8xlarge-amd64.security-group-id: sg-0759f4a43faada557
328+
dynamic.linux-d160-m7-8xlarge-amd64.max-instances: "5"
329+
dynamic.linux-d160-m7-8xlarge-amd64.subnet-id: subnet-0263af86f44821eac
330+
dynamic.linux-d160-m7-8xlarge-amd64.disk: "160"
331+
304332
# cpu:memory (1:2)
305333
dynamic.linux-cxlarge-arm64.type: aws
306334
dynamic.linux-cxlarge-arm64.region: us-east-1

0 commit comments

Comments
 (0)