Skip to content

Commit 99f8203

Browse files
k-routhushubham-pathak-03rbtrjpayne3506
authored
ci: [Service Tags] add public ips with service tags for LBs during cluster creation (#3277)
* Create an outbound public ip for LB/Cilium cluster * create and attach public ip for cilium e2e cluster * Test cluster independent ip creation * Test outbound public ip creation * Test outbound public ip creation * Test outbound public ip creation with azcli creds * Test outbound public ip creation with azcli creds * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add managed identity to public ip/load balancer * Add managed identity to public ip/load balancer * Test wo managed identity * Test wo managed identity * Add Public ip to one cluster * Add public to all cluster creations * Add public ip * Fix spacing * Fix spacing * Add LB to win cni v1 cluster * Add LB to win cni v1 cluster * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * updated service tag to 'DelegatedNetworkControllerTest' * create public IP as target * add ipv6 public ips to dualstack * updated v6 ip * remove space * added public ip for nodesubnet-byocni-nokubeproxy-up resource * addressed comments on PR * parameterize ip v4 & v6 Co-authored-by: Evan Baker <[email protected]> Signed-off-by: Keerthana Routhu <[email protected]> * address comments * address PR comments * Update hack/aks/Makefile Co-authored-by: John Payne <[email protected]> Signed-off-by: Keerthana Routhu <[email protected]> --------- Signed-off-by: Keerthana Routhu <[email protected]> Co-authored-by: shubham-pathak-03 <[email protected]> Co-authored-by: Evan Baker <[email protected]> Co-authored-by: John Payne <[email protected]>
1 parent aa15457 commit 99f8203

File tree

1 file changed

+62
-34
lines changed

1 file changed

+62
-34
lines changed

‎hack/aks/Makefile‎

Lines changed: 62 additions & 34 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,11 @@ OS_SKU_WIN ?= Windows2022
1919
REGION ?= westus2
2020
VM_SIZE ?= Standard_B2s
2121
VM_SIZE_WIN ?= Standard_B2s
22+
IP_TAG ?= FirstPartyUsage=/DelegatedNetworkControllerTest
23+
IP_PREFIX ?= serviceTaggedIp
24+
PUBLIC_IP_ID ?= /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/publicIPAddresses
25+
PUBLIC_IPv4 ?= $(PUBLIC_IP_ID)/$(IP_PREFIX)-$(CLUSTER)-v4
26+
PUBLIC_IPv6 ?= $(PUBLIC_IP_ID)/$(IP_PREFIX)-$(CLUSTER)-v6
2227
KUBE_PROXY_JSON_PATH ?= ./kube-proxy.json
2328

2429
# overrideable variables
@@ -43,6 +48,23 @@ azcfg: ## Set the $AZCLI to use aks-preview
4348
@$(AZCLI) extension add --name aks-preview --yes
4449
@$(AZCLI) extension update --name aks-preview
4550

51+
ip:
52+
$(AZCLI) network public-ip create --name $(IP_PREFIX)-$(CLUSTER)-$(IPVERSION) \
53+
--resource-group $(GROUP) \
54+
--allocation-method Static \
55+
--ip-tags $(IP_TAG) \
56+
--location $(REGION) \
57+
--sku Standard \
58+
--tier Regional \
59+
--version IP$(IPVERSION)
60+
61+
ipv4: IPVERSION = v4
62+
ipv4: ip
63+
64+
ipv6: IPVERSION = v6
65+
ipv6: ip
66+
67+
4668
set-kubeconf: ## Adds the kubeconf for $CLUSTER
4769
$(AZCLI) aks get-credentials -n $(CLUSTER) -g $(GROUP)
4870

@@ -89,23 +111,22 @@ overlay-net-up: ## Create vnet, nodenet subnets
89111
$(AZCLI) network vnet create -g $(GROUP) -l $(REGION) --name $(VNET) --address-prefixes 10.0.0.0/8 -o none
90112
$(AZCLI) network vnet subnet create -g $(GROUP) --vnet-name $(VNET) --name nodenet --address-prefix 10.10.0.0/16 -o none
91113

92-
93114
##@ AKS Clusters
94115

95116
byocni-up: swift-byocni-up ## Alias to swift-byocni-up
96117
cilium-up: swift-cilium-up ## Alias to swift-cilium-up
97118
up: swift-up ## Alias to swift-up
98119

99120

100-
nodesubnet-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an NodeSubnet BYO CNI cluster without kube-proxy
121+
nodesubnet-byocni-nokubeproxy-up: rg-up ipv4 overlay-net-up ## Brings up an NodeSubnet BYO CNI cluster without kube-proxy
101122
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
102123
--auto-upgrade-channel $(AUTOUPGRADE) \
103124
--node-os-upgrade-channel $(NODEUPGRADE) \
104125
--kubernetes-version $(K8S_VER) \
105126
--node-count $(NODE_COUNT) \
106127
--node-vm-size $(VM_SIZE) \
107-
--load-balancer-sku standard \
108128
--max-pods 250 \
129+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
109130
--network-plugin none \
110131
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
111132
--os-sku $(OS_SKU) \
@@ -114,14 +135,14 @@ nodesubnet-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an NodeSubne
114135
--yes
115136
@$(MAKE) set-kubeconf
116137

117-
overlay-byocni-up: rg-up overlay-net-up ## Brings up a Linux Overlay BYO CNI cluster
138+
overlay-byocni-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay BYO CNI cluster
118139
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
119140
--auto-upgrade-channel $(AUTOUPGRADE) \
120141
--node-os-upgrade-channel $(NODEUPGRADE) \
121142
--kubernetes-version $(K8S_VER) \
122143
--node-count $(NODE_COUNT) \
123144
--node-vm-size $(VM_SIZE) \
124-
--load-balancer-sku standard \
145+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
125146
--network-plugin none \
126147
--network-plugin-mode overlay \
127148
--pod-cidr 192.168.0.0/16 \
@@ -134,14 +155,14 @@ ifeq ($(OS),windows)
134155
$(MAKE) windows-nodepool-up
135156
endif
136157

137-
overlay-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an Overlay BYO CNI cluster without kube-proxy
158+
overlay-byocni-nokubeproxy-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay BYO CNI cluster without kube-proxy
138159
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
139160
--auto-upgrade-channel $(AUTOUPGRADE) \
140161
--node-os-upgrade-channel $(NODEUPGRADE) \
141162
--kubernetes-version $(K8S_VER) \
142163
--node-count $(NODE_COUNT) \
143164
--node-vm-size $(VM_SIZE) \
144-
--load-balancer-sku basic \
165+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
145166
--network-plugin none \
146167
--network-plugin-mode overlay \
147168
--pod-cidr 192.168.0.0/16 \
@@ -151,14 +172,14 @@ overlay-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an Overlay BYO
151172
--yes
152173
@$(MAKE) set-kubeconf
153174

154-
overlay-cilium-up: rg-up overlay-net-up ## Brings up an Overlay Cilium cluster
175+
overlay-cilium-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay Cilium cluster
155176
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
156177
--auto-upgrade-channel $(AUTOUPGRADE) \
157178
--node-os-upgrade-channel $(NODEUPGRADE) \
158179
--kubernetes-version $(K8S_VER) \
159180
--node-count $(NODE_COUNT) \
160181
--node-vm-size $(VM_SIZE) \
161-
--load-balancer-sku basic \
182+
--load-balancer-outbound-ips (PUBLIC_IPv4) \
162183
--network-plugin azure \
163184
--network-dataplane cilium \
164185
--network-plugin-mode overlay \
@@ -168,14 +189,14 @@ overlay-cilium-up: rg-up overlay-net-up ## Brings up an Overlay Cilium cluster
168189
--yes
169190
@$(MAKE) set-kubeconf
170191

171-
overlay-up: rg-up overlay-net-up ## Brings up an Overlay AzCNI cluster
192+
overlay-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay AzCNI cluster
172193
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
173194
--auto-upgrade-channel $(AUTOUPGRADE) \
174195
--node-os-upgrade-channel $(NODEUPGRADE) \
175196
--kubernetes-version $(K8S_VER) \
176197
--node-count $(NODE_COUNT) \
177198
--node-vm-size $(VM_SIZE) \
178-
--load-balancer-sku basic \
199+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
179200
--network-plugin azure \
180201
--network-plugin-mode overlay \
181202
--pod-cidr 192.168.0.0/16 \
@@ -184,14 +205,14 @@ overlay-up: rg-up overlay-net-up ## Brings up an Overlay AzCNI cluster
184205
--yes
185206
@$(MAKE) set-kubeconf
186207

187-
swift-byocni-up: rg-up swift-net-up ## Bring up a SWIFT BYO CNI cluster
208+
swift-byocni-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT BYO CNI cluster
188209
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
189210
--auto-upgrade-channel $(AUTOUPGRADE) \
190211
--node-os-upgrade-channel $(NODEUPGRADE) \
191212
--kubernetes-version $(K8S_VER) \
192213
--node-count $(NODE_COUNT) \
193214
--node-vm-size $(VM_SIZE) \
194-
--load-balancer-sku standard \
215+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
195216
--network-plugin none \
196217
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
197218
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -203,14 +224,14 @@ ifeq ($(OS),windows)
203224
endif
204225
@$(MAKE) set-kubeconf
205226

206-
swift-byocni-nokubeproxy-up: rg-up swift-net-up ## Bring up a SWIFT BYO CNI cluster without kube-proxy
227+
swift-byocni-nokubeproxy-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT BYO CNI cluster without kube-proxy, add managed identity and public ip
207228
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
208229
--auto-upgrade-channel $(AUTOUPGRADE) \
209230
--node-os-upgrade-channel $(NODEUPGRADE) \
210231
--kubernetes-version $(K8S_VER) \
211232
--node-count $(NODE_COUNT) \
212233
--node-vm-size $(VM_SIZE) \
213-
--load-balancer-sku basic \
234+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
214235
--network-plugin none \
215236
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
216237
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -220,14 +241,14 @@ swift-byocni-nokubeproxy-up: rg-up swift-net-up ## Bring up a SWIFT BYO CNI clus
220241
--yes
221242
@$(MAKE) set-kubeconf
222243

223-
swift-cilium-up: rg-up swift-net-up ## Bring up a SWIFT Cilium cluster
244+
swift-cilium-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT Cilium cluster
224245
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
225246
--auto-upgrade-channel $(AUTOUPGRADE) \
226247
--node-os-upgrade-channel $(NODEUPGRADE) \
227248
--kubernetes-version $(K8S_VER) \
228249
--node-count $(NODE_COUNT) \
229250
--node-vm-size $(VM_SIZE) \
230-
--load-balancer-sku basic \
251+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
231252
--network-plugin azure \
232253
--network-dataplane cilium \
233254
--aks-custom-headers AKSHTTPCustomFeatures=Microsoft.ContainerService/CiliumDataplanePreview \
@@ -237,54 +258,56 @@ swift-cilium-up: rg-up swift-net-up ## Bring up a SWIFT Cilium cluster
237258
--yes
238259
@$(MAKE) set-kubeconf
239260

240-
swift-up: rg-up swift-net-up ## Bring up a SWIFT AzCNI cluster
261+
swift-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT AzCNI cluster
241262
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
242263
--auto-upgrade-channel $(AUTOUPGRADE) \
243264
--node-os-upgrade-channel $(NODEUPGRADE) \
244265
--kubernetes-version $(K8S_VER) \
245266
--node-count $(NODE_COUNT) \
246267
--node-vm-size $(VM_SIZE) \
247-
--load-balancer-sku basic \
268+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
248269
--network-plugin azure \
249270
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
250271
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
251272
--no-ssh-key \
252273
--yes
253274
@$(MAKE) set-kubeconf
254275

255-
swiftv2-multitenancy-cluster-up: rg-up
276+
swiftv2-multitenancy-cluster-up: rg-up ipv4
256277
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
257278
--network-plugin azure \
258279
--network-plugin-mode overlay \
259280
--kubernetes-version $(K8S_VER) \
260281
--nodepool-name "mtapool" \
261282
--node-vm-size $(VM_SIZE) \
262283
--node-count 2 \
284+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
263285
--nodepool-tags fastpathenabled=true \
264286
--no-ssh-key \
265287
--yes
266288
@$(MAKE) set-kubeconf
267289

268-
swiftv2-dummy-cluster-up: rg-up swift-net-up ## Bring up a SWIFT AzCNI cluster
290+
swiftv2-dummy-cluster-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT AzCNI cluster
269291
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
270292
--network-plugin azure \
271293
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
272294
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
295+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
273296
--no-ssh-key \
274297
--yes
275298
@$(MAKE) set-kubeconf
276299

277300
# The below Vnet Scale clusters are currently only in private preview and available with Kubernetes 1.28
278301
# These AKS clusters can only be created in a limited subscription listed here:
279302
# https://dev.azure.com/msazure/CloudNativeCompute/_git/aks-rp?path=/resourceprovider/server/microsoft.com/containerservice/flags/network_flags.go&version=GBmaster&line=134&lineEnd=135&lineStartColumn=1&lineEndColumn=1&lineStyle=plain&_a=contents
280-
vnetscale-swift-byocni-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster
303+
vnetscale-swift-byocni-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster
281304
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
282305
--auto-upgrade-channel $(AUTOUPGRADE) \
283306
--node-os-upgrade-channel $(NODEUPGRADE) \
284307
--kubernetes-version $(K8S_VER) \
285308
--node-count $(NODE_COUNT) \
286309
--node-vm-size $(VM_SIZE) \
287-
--load-balancer-sku basic \
310+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
288311
--network-plugin none \
289312
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
290313
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -293,14 +316,14 @@ vnetscale-swift-byocni-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale
293316
--yes
294317
@$(MAKE) set-kubeconf
295318

296-
vnetscale-swift-byocni-nokubeproxy-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster without kube-proxy
319+
vnetscale-swift-byocni-nokubeproxy-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster without kube-proxy
297320
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
298321
--auto-upgrade-channel $(AUTOUPGRADE) \
299322
--node-os-upgrade-channel $(NODEUPGRADE) \
300323
--kubernetes-version $(K8S_VER) \
301324
--node-count $(NODE_COUNT) \
302325
--node-vm-size $(VM_SIZE) \
303-
--load-balancer-sku basic \
326+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
304327
--network-plugin none \
305328
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
306329
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -310,14 +333,14 @@ vnetscale-swift-byocni-nokubeproxy-up: rg-up vnetscale-swift-net-up ## Bring up
310333
--yes
311334
@$(MAKE) set-kubeconf
312335

313-
vnetscale-swift-cilium-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT Cilium cluster
336+
vnetscale-swift-cilium-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT Cilium cluster
314337
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
315338
--auto-upgrade-channel $(AUTOUPGRADE) \
316339
--node-os-upgrade-channel $(NODEUPGRADE) \
317340
--kubernetes-version $(K8S_VER) \
318341
--node-count $(NODE_COUNT) \
319342
--node-vm-size $(VM_SIZE) \
320-
--load-balancer-sku basic \
343+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
321344
--network-plugin azure \
322345
--network-dataplane cilium \
323346
--aks-custom-headers AKSHTTPCustomFeatures=Microsoft.ContainerService/CiliumDataplanePreview \
@@ -327,28 +350,29 @@ vnetscale-swift-cilium-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale
327350
--yes
328351
@$(MAKE) set-kubeconf
329352

330-
vnetscale-swift-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT AzCNI cluster
353+
vnetscale-swift-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT AzCNI cluster
331354
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
332355
--auto-upgrade-channel $(AUTOUPGRADE) \
333356
--node-os-upgrade-channel $(NODEUPGRADE) \
334357
--kubernetes-version $(K8S_VER) \
335358
--node-count $(NODE_COUNT) \
336359
--node-vm-size $(VM_SIZE) \
337-
--load-balancer-sku basic \
360+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
338361
--network-plugin azure \
339362
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
340363
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
341364
--no-ssh-key \
342365
--yes
343366
@$(MAKE) set-kubeconf
344367

345-
cniv1-up: rg-up overlay-net-up ## Bring up a CNIv1 cluster
368+
cniv1-up: rg-up ipv4 overlay-net-up ## Bring up a CNIv1 cluster
346369
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
347370
--auto-upgrade-channel $(AUTOUPGRADE) \
348371
--node-os-upgrade-channel $(NODEUPGRADE) \
349372
--kubernetes-version $(K8S_VER) \
350373
--node-count $(NODE_COUNT) \
351374
--node-vm-size $(VM_SIZE) \
375+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
352376
--max-pods 250 \
353377
--network-plugin azure \
354378
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
@@ -360,13 +384,14 @@ ifeq ($(OS),windows)
360384
$(MAKE) windows-nodepool-up
361385
endif
362386

363-
dualstack-overlay-up: rg-up overlay-net-up ## Brings up an dualstack Overlay cluster with Linux node only
387+
dualstack-overlay-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up an dualstack Overlay cluster with Linux node only
364388
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
365389
--auto-upgrade-channel $(AUTOUPGRADE) \
366390
--node-os-upgrade-channel $(NODEUPGRADE) \
367391
--kubernetes-version $(K8S_VER) \
368392
--node-count $(NODE_COUNT) \
369393
--node-vm-size $(VM_SIZE) \
394+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
370395
--network-plugin azure \
371396
--network-plugin-mode overlay \
372397
--subscription $(SUB) \
@@ -376,13 +401,14 @@ dualstack-overlay-up: rg-up overlay-net-up ## Brings up an dualstack Overlay clu
376401
--yes
377402
@$(MAKE) set-kubeconf
378403

379-
dualstack-overlay-byocni-up: rg-up overlay-net-up ## Brings up an dualstack Overlay BYO CNI cluster
404+
dualstack-overlay-byocni-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up an dualstack Overlay BYO CNI cluster
380405
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
381406
--auto-upgrade-channel $(AUTOUPGRADE) \
382407
--node-os-upgrade-channel $(NODEUPGRADE) \
383408
--kubernetes-version $(K8S_VER) \
384409
--node-count $(NODE_COUNT) \
385410
--node-vm-size $(VM_SIZE) \
411+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
386412
--network-plugin none \
387413
--network-plugin-mode overlay \
388414
--subscription $(SUB) \
@@ -395,13 +421,14 @@ ifeq ($(OS),windows)
395421
$(MAKE) windows-nodepool-up
396422
endif
397423

398-
cilium-dualstack-up: rg-up overlay-net-up ## Brings up a Cilium Dualstack Overlay cluster with Linux node only
424+
cilium-dualstack-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up a Cilium Dualstack Overlay cluster with Linux node only
399425
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
400426
--auto-upgrade-channel $(AUTOUPGRADE) \
401427
--node-os-upgrade-channel $(NODEUPGRADE) \
402428
--kubernetes-version $(K8S_VER) \
403429
--node-count $(NODE_COUNT) \
404430
--node-vm-size $(VM_SIZE) \
431+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
405432
--network-plugin azure \
406433
--network-plugin-mode overlay \
407434
--network-dataplane cilium \
@@ -412,13 +439,14 @@ cilium-dualstack-up: rg-up overlay-net-up ## Brings up a Cilium Dualstack Overla
412439
--yes
413440
@$(MAKE) set-kubeconf
414441

415-
dualstack-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up a Dualstack overlay BYOCNI cluster with Linux node only and no kube-proxy
442+
dualstack-byocni-nokubeproxy-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up a Dualstack overlay BYOCNI cluster with Linux node only and no kube-proxy
416443
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
417444
--auto-upgrade-channel $(AUTOUPGRADE) \
418445
--node-os-upgrade-channel $(NODEUPGRADE) \
419446
--kubernetes-version $(K8S_VER) \
420447
--node-count $(NODE_COUNT) \
421448
--node-vm-size $(VM_SIZE) \
449+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
422450
--network-plugin none \
423451
--network-plugin-mode overlay \
424452
--subscription $(SUB) \

0 commit comments

Comments
 (0)