Publish pytest xml data (#2571)

#### Reference Issues/PRs
Monday ticket ref: 9735825395

#### What does this implement or fix?
Add a workflow that saves the pytest data into an ArcticDB db in S3.
The workflow aggregates all of the pytest xmls (one for each execution)
into a single csv and thus into a single data frame/symbol so they can
be written in parallel to the DB.

The CSVs/dataframe look like this:
``` csv
python_version,test_type,test_name,status,time,message
3.8,unit,test_parallel_write_sort_merge[real_gcp_store_factory-False-10-1-1],skipped,0.000,Real GCP can be used only when persistent storage is enabled
3.8,unit,test_parallel_write_sort_merge[real_gcp_store_factory-False-None-None-None],skipped,0.000,Real GCP can be used only when persistent storage is enabled
3.8,unit,test_sort_merge_append[version_store_factory-EncodingVersion.V1-True],passed,0.050, 
3.8,unit,test_sort_merge_append[version_store_factory-EncodingVersion.V1-False],passed,0.065, 
3.8,unit,test_sort_merge_append[version_store_factory-EncodingVersion.V2-True],passed,0.048, 
3.8,unit,test_sort_merge_append[version_store_factory-EncodingVersion.V2-False],passed,0.062, 
3.8,unit,test_sort_merge_append[in_memory_store_factory-EncodingVersion.V1-True],passed,0.030, 
```

I have also prepopulated the library
[here](https://eu-west-1.console.aws.amazon.com/s3/buckets/arcticdb-ci-pytest-results?region=eu-west-1&bucketType=general&prefix=pytest_results/&showversions=false)
with data from most of the runs from the past year.
The
[script](https://github.com/man-group/ArcticDB/pull/2571/files#diff-0356fc4ff5e79a810d9924232a2e09ce73a242efdd9abad9ca4467ad3d27ae37)
used to save the pytest data can be run both for:
- a single run - this is how it runs in the CI
- multiple runs - this is how it can be run locally, it just needs the
GH tool to be set up locally

#### Any other comments?

#### Checklist

<details>
  <summary>
   Checklist for code changes...
  </summary>
 
- [ ] Have you updated the relevant docstrings, documentation and
copyright notice?
- [ ] Is this contribution tested against [all ArcticDB's
features](../docs/mkdocs/docs/technical/contributing.md)?
- [ ] Do all exceptions introduced raise appropriate [error
messages](https://docs.arcticdb.io/error_messages/)?
 - [ ] Are API changes highlighted in the PR description?
- [ ] Is the PR labelled as enhancement or bug so it appears in
autogenerated release notes?
</details>

<!--
Thanks for contributing a Pull Request to ArcticDB! Please ensure you
have taken a look at:
- ArcticDB's Code of Conduct:
https://github.com/man-group/ArcticDB/blob/master/CODE_OF_CONDUCT.md
- ArcticDB's Contribution Licensing:
https://github.com/man-group/ArcticDB/blob/master/docs/mkdocs/docs/technical/contributing.md#contribution-licensing
-->

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

Author: G-D-Petrov

.github/workflows/build.yml

@@ -482,6 +482,17 @@ jobs:
       DEBUG_ENABLED: ${{ needs.storage_type.outputs.DEBUG_ENABLED }}            
       DEBUG_LOGGING_ENABLED: ${{ needs.storage_type.outputs.DEBUG_LOGGING_ENABLED }}            
 
+  publish_pytest_data:
+    needs: [common_config,build-python-wheels-linux, build-python-wheels-windows, build-python-wheels-macos]
+    if: |
+      always() &&
+      !cancelled()
+    uses: ./.github/workflows/publish_pytest_data.yml
+    secrets: inherit
+    permissions: {contents: write}
+    with:
+      environment: ${{needs.common_config.outputs.publish_env}}
+
   can_merge:
     needs: [cpp-test-linux, cpp-test-windows, cpp-test-macos, build-python-wheels-linux, build-python-wheels-windows, build-python-wheels-macos, persistent_storage_verify_linux, persistent_storage_verify_windows]
     if: |

.github/workflows/build_steps.yml

@@ -162,8 +162,6 @@ jobs:
 
       - name: Setup cmake
         uses: jwlawson/actions-setup-cmake@v2
-        with:
-          cmake-version: '3.31.6'
 
       - name: Use cmake
         run: cmake --version

.github/workflows/publish_pytest_data.yml

@@ -0,0 +1,67 @@
+name: Publish pytest data to S3
+on: 
+  workflow_call:
+    inputs:
+      environment: { type: string, required: true }
+  workflow_dispatch:
+    inputs:
+      environment: { type: environment, required: true }
+      run_id: { type: number, required: true }
+run-name: Publish ${{github.ref}} to arcticdb-pytest-data
+permissions:
+  contents: read
+jobs:
+  sync_pytest_xmls:
+    runs-on: ubuntu-22.04
+    container:
+      image: ubuntu:22.04 # Native runner doesn't allow setting up the ca softlinks required below
+    steps:
+      - name: Select Python
+        uses: actions/[email protected]
+        with:
+          python-version: "3.11"
+
+      - name: Setup env vars
+        run: |
+          # We are using an absolute path here because for some reason the upload-artifact action
+          # does not work correctly with a relative path.
+          echo "ARTEFACT_PATH=/tmp/${{ github.run_id }}" >> $GITHUB_ENV
+          # get the current date and time in UTC
+          echo "GITHUB_RUN_STARTED_AT=$(date -u +%Y-%m-%dT%H:%M:%SZ)" >> $GITHUB_ENV
+
+      - name: Gather pytest xmls from run ${{ github.run_id }}
+        id: gather-pytest-xmls
+        uses: actions/download-artifact@v4
+        with:
+            pattern: "pytest-*"
+            run-id: ${{ github.run_id }}
+            github-token: ${{github.token}}  
+            path: ${{ env.ARTEFACT_PATH }}
+
+      - name: Checkout
+        uses: actions/[email protected]
+
+      - name: Install requirements
+        run: |
+          apt update
+          apt install -y git
+          python3 -m pip install arcticdb[Testing] click
+
+      - name: Setup softlink for SSL
+        shell: bash -el {0}
+        run: |
+            mkdir -p /etc/pki/tls
+            ln -s /usr/lib/ssl/certs /etc/pki/tls/certs
+            ln -s /etc/ssl/certs/ca-certificates.crt /etc/pki/tls/certs/ca-bundle.crt
+
+      - name: Set persistent storage variables
+        uses: ./.github/actions/set_persistent_storage_env_vars
+        with:
+          bucket: "arcticdb-ci-pytest-results"
+          aws_access_key: "${{ secrets.AWS_S3_ACCESS_KEY }}"
+          aws_secret_key: "${{ secrets.AWS_S3_SECRET_KEY }}"
+
+      - name: Process pytest xmls
+        run: |
+          ls -R ${{ env.ARTEFACT_PATH }}
+          python3 build_tooling/process_pytest_artifacts.py --download-dir ${{ env.ARTEFACT_PATH }} --use-github-actions