Swiftv2 Long running cluster - test pipeline (#4099)

* init swiftv2 pipeline for persistent tests on aks clusters.

* Set default params.

* Update pipeline.yaml for Azure Pipelines

* long running pipeline infra setup.

* Set depedencies for pipeline jobs.

* template for long running cluster.

* set template.

* set dependency for jobs.

* Change job name.

* Set job scripts.

* set pipeline scripts with permissions.

* set script path.

* set template params.

* Set pipeline template for long running clusters.

* test change.

* set params.

* set params in pipeline scripts.

* set cx vnet name.

* Create clusters parallely

* create NSG.

* Change dependency for creating nsg.

* Update .pipelines/swiftv2-long-running/scripts/create_peerings.sh

Co-authored-by: Copilot <[email protected]>
Signed-off-by: sivakami-projects <[email protected]>

* Update .pipelines/swiftv2-long-running/scripts/create_nsg.sh

Co-authored-by: Copilot <[email protected]>
Signed-off-by: sivakami-projects <[email protected]>

* Add success/error message for each resource creation.

* Remove unused argument from template.

* Rename subnets. Changed NSG rules to prevent network connectivity between vnet 1 subnet 1 and vnet 1 subnet2.

* Private endpoints.

* Change pipeline template.

* Set output variables.

* private endpoint.

* update private endpoint.

* create storage account.

* disallow shared key access.

* change pipeline template.

* Removed unused param.

* Link private endpoint dns to vnet a2 and vnet a3.

* attach nsg rule to subnets.

* Link nsg with subnet.

* Private endpoint fix - long running pipeline.

* Verify each resource creation - long running cluster test pipeline.

* verify storage account creation.

* use make tragets to create aks clusters.

* misc.

* set aks custom headers.

* Use aks common field in swiftv2-podsubnet-cluster creation.

---------

Signed-off-by: sivakami-projects <[email protected]>
Co-authored-by: sivakami <[email protected]>
Co-authored-by: Copilot <[email protected]>

Author: 3 people

.pipelines/swiftv2-long-running/scripts/create_vnets.sh

@@ -76,4 +76,4 @@ for i in "${!VNAMES[@]}"; do
     done
 done
 
-echo "All VNets and subnets created and verified successfully."
+echo "All VNets and subnets created and verified successfully."

.pipelines/swiftv2-long-running/template/long-running-pipeline-template.yaml

@@ -169,4 +169,4 @@ stages:
               export BUILD_ID=$(Build.BuildId)
               cd test/integration/swiftv2/long_running_cluster
               ginkgo -v -trace -fail-fast datapath-test.go
-            displayName: "Run Ginkgo Datapath Suite"
+            displayName: "Run Ginkgo Datapath Suite"