Limiting number of pytest workers to 8: avoid crashing deploynode (#2533)

* limiting number of pytest workers to 4

* Revert "limiting number of pytest workers to 4"

This reverts commit fddb96c.

* testing gh workflow on slurm-runner instead of deploy node

* Revert "testing gh workflow on slurm-runner instead of deploy node"

This reverts commit 164a98b.

* use environment var to detect self-hosted: limit cores

Author: bryance-flexcompute

tests/conftest.py

@@ -72,6 +72,9 @@ def pytest_xdist_auto_num_workers(config):
     cores = min(cores, mem_limited_cores)
 
     if os.getenv("GITHUB_ACTIONS"):
+        if os.getenv("RUNNER_ENVIRONMENT") == "self-hosted":
+            MAX_SELF_HOSTED_CORES = 8
+            return min(MAX_SELF_HOSTED_CORES, cores)
         return cores
     return max(1, cores - 1)