Offline GitHub workflow (#733)

* Adds the offline workflow to the GitHub Actions pipeline

* Uses the branch name from the pull request or the branch name from the commit

* Allow traffic between u1 and u2

* Blocks all outbound traffic from u2 except for SSH

* Prepares offline resources on u1 before copying the tarball to u2

* Finds the offline tarball on u1 before copying it to u2

* Build the u2 Azure instance at the same time as the u1 instance

* Don't clean up azure resources in offline workflow

* Add wait for SSH to be ready to offline workflow

* Wait for outbound connectivity to be blocked in u2

* Run LME installer on u2 in offline workflow

* Runs LME installer on u2 in offline workflow with non-interactive mode

* Brings the u2 server back online to run the tests

* Runs apt-get on the u2 server before installing the test requirements

* Installs python to run the tests on the u2 server

* Removes the servers at the end of the workflow

* Stop cleanup of Azure resources for debugging

* Installs python3-venv on the u2 server

* Put the servers both in the same VNet and subnet and block all outbound traffic from the offline server.

* Fixes the password generator to output 12 characters.

* Prepares and runs the tests with the server that is online

* Sets up the Windows server to be used for the offline tests.

* Disown the HTTP server process to avoid hanging the workflow.

* Allows inbound traffic from VNet to u1 (for HTTP server on port 8080)

* Uses SCP to copy the tarball from u1 to w1.

* Generates an SSH key with no passphrase on w1

* Uses the SSH key generated on w1 to copy the tarball from u1 to w1

* Using a different method to generate the SSH key on w1

* Moves the key generation step to earlier in the workflow

* Escapes the empty passphrase in the PowerShell script

* Escapes the empty passphrase in the PowerShell script

* Installs the Elastic Agent on w1

* Run the end to end tests on the offline VM

* Uncommented pull_request triggers for all workflows

Author: cbaxley

.github/workflows/cluster.yml

@@ -1,9 +1,10 @@
 name: Cluster Run - Minimega
 
 on:
-  # pull_request:
-  #   branches:
-  #     - '*'
+  pull_request:
+    branches:
+      - 'develop'
+      - 'main'
   workflow_dispatch:
     inputs:
       azure_region:
@@ -306,7 +307,7 @@ jobs:
                 -H \"kbn-xsrf: true\" \
                 -H \"Content-Type: application/json\" \
                 -d \"{\\\"policy_id\\\":\\\"$POLICY_ID\\\"}\" |
-              jq -r .item.api_key
+              jq -r '.item.api_key'
             '
           ")
           echo "Retrieved enrollment token: $ENROLLMENT_TOKEN"

.github/workflows/cluster_redhat.yml

@@ -28,7 +28,8 @@ on:
           - westeurope
   pull_request:
     branches:
-      - '*'
+      - 'develop'
+      - 'main'
 
 jobs:
   build-and-test-cluster-redhat: