Update Kubernetes service pod spec and fix batch service test

- K8s Service: Update Kata container job spec with hostNetwork: True, HOST_UID=1337, capabilities: ALL, and standardized volume size. Skip default credential loading if K8S_E2E env var is set.
- K8s Tests: Update unit tests to verify spec generation and mock correctly. Update e2e tests to verify job Running status instead of completion to avoid timeouts with default command. Skip e2e test if K8S_E2E env var is not set.
- Local Tests: Update kubernetes e2e test script with correct filename.
- Batch Service Test: Fix mock return value to be a Job object to resolve AttributeError.
- Deps: Add google-api-python-client to root Pipfile.

Author: javanlacerda

Pipfile

@@ -11,6 +11,7 @@ protobuf = "==4.23.4"
 psutil = "==5.9.4"
 google-cloud-ndb = "==2.3.4"
 kubernetes = "==34.1.0"
+google-api-python-client = "==2.93.0"
 
 [dev-packages]
 Fabric = "==1.14.1"

Pipfile.lock

@@ -219,13 +219,10 @@ def _create_job_body(config: KubernetesJobConfig, input_url: str) -> dict:
 class KubernetesService(RemoteTaskInterface):
   """A remote task execution client for Kubernetes."""
 
-  def __init__(self):
+  def __init__(self, k8s_config_loaded: bool = False):
     # In e2e tests, the kubeconfig is already loaded by the test setup.
-    if not os.getenv('K8S_E2E'):
-      try:
-        k8s_config.load_kube_config()
-      except (k8s_config.ConfigException, TypeError):
-        self._load_gke_credentials()
+    if not k8s_config_loaded:
+      self._load_gke_credentials()
 
     self._core_api = k8s_client.CoreV1Api()
     self._batch_api = k8s_client.BatchV1Api()

src/clusterfuzz/_internal/k8s/service.py

@@ -152,7 +152,7 @@ def get_batch_config(key):
       k8s_config.load_kube_config(config_file=cls.kubeconfig_path)
       cls.api_client = k8s_client.BatchV1Api()
 
-    cls.kubernetes_client = kubernetes_service.KubernetesService()
+    cls.kubernetes_client = kubernetes_service.KubernetesService(k8s_config_loaded=True)
     data_types.Job(name='test-job', platform='LINUX').put()
     data_types.Job(name='test-job1', platform='LINUX').put()
     data_types.Job(name='test-job2', platform='LINUX').put()