Kubernetes Connection - the server could not find the requested resource

[marclipoff]

I am trying to run the kubernetes hello world example, as shown here (section: Try Clipper's hello-world).

When I run it, I get a "resource not found" error. See full error below.

I've tried running this on a cloud-based kubernetes cluster (AWS EKS) and on minikube. I've played with the inputs to KubernetesContainerManager(), with luck.

2020-05-12 14:22:06,782 DEBUG: response body: {"kind":"NamespaceList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces","resourceVersion":"6661"},"items":[{"metadata":{"name":"default","selfLink":"/api/v1/namespaces/default","uid":"26478793-4c71-4e16-99ea-653564c39a41","resourceVersion":"154","creationTimestamp":"2020-05-11T16:07:47Z","managedFields":[{"manager":"kube-apiserver","operation":"Update","apiVersion":"v1","time":"2020-05-11T16:07:47Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}},{"metadata":{"name":"kube-node-lease","selfLink":"/api/v1/namespaces/kube-node-lease","uid":"bea9e161-93c3-44ed-8c3a-ad088c4c98ff","resourceVersion":"43","creationTimestamp":"2020-05-11T16:07:45Z","managedFields":[{"manager":"kube-apiserver","operation":"Update","apiVersion":"v1","time":"2020-05-11T16:07:45Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}},{"metadata":{"name":"kube-public","selfLink":"/api/v1/namespaces/kube-public","uid":"0dc53c37-fc35-4c2d-b5d1-0d6ede70bf23","resourceVersion":"36","creationTimestamp":"2020-05-11T16:07:45Z","managedFields":[{"manager":"kube-apiserver","operation":"Update","apiVersion":"v1","time":"2020-05-11T16:07:45Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}},{"metadata":{"name":"kube-system","selfLink":"/api/v1/namespaces/kube-system","uid":"94aaa004-6db2-49a1-a8e4-3c0b581fde67","resourceVersion":"16","creationTimestamp":"2020-05-11T16:07:45Z","managedFields":[{"manager":"kube-apiserver","operation":"Update","apiVersion":"v1","time":"2020-05-11T16:07:45Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}},{"metadata":{"name":"qs","selfLink":"/api/v1/namespaces/qs","uid":"400107d9-a090-4343-8610-36af351f71d1","resourceVersion":"949","creationTimestamp":"2020-05-11T16:11:53Z","managedFields":[{"manager":"kubectl","operation":"Update","apiVersion":"v1","time":"2020-05-11T16:11:53Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}}]}

2020-05-12 14:22:06,789 INFO: Your service_types are {'redis': 'NodePort', 'management': 'NodePort', 'query': 'NodePort', 'query-rpc': 'NodePort', 'metric': 'NodePort'}
2020-05-12 14:22:06,808 DEBUG: response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"clusterroles.rbac.authorization.k8s.io \"default-cluster-prometheus\" already exists","reason":"AlreadyExists","details":{"name":"default-cluster-prometheus","group":"rbac.authorization.k8s.io","kind":"clusterroles"},"code":409}

2020-05-12 14:22:06,808 INFO: {'name': 'default-cluster-prometheus', 'group': 'rbac.authorization.k8s.io', 'kind': 'clusterroles'} already exists, skipping!
2020-05-12 14:22:06,816 DEBUG: response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"clusterrolebindings.rbac.authorization.k8s.io \"default-cluster-prometheus\" already exists","reason":"AlreadyExists","details":{"name":"default-cluster-prometheus","group":"rbac.authorization.k8s.io","kind":"clusterrolebindings"},"code":409}

2020-05-12 14:22:06,816 INFO: {'name': 'default-cluster-prometheus', 'group': 'rbac.authorization.k8s.io', 'kind': 'clusterrolebindings'} already exists, skipping!
2020-05-12 14:22:06,830 DEBUG: response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"the server could not find the requested resource","reason":"NotFound","details":{},"code":404}

Traceback (most recent call last):
  File "server-k8s.py", line 14, in <module>
    clipper_conn.start_clipper()
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/clipper_admin/clipper_admin.py", line 139, in start_clipper
    qf_http_timeout_content, num_frontend_replicas)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/clipper_admin/kubernetes/kubernetes_container_manager.py", line 259, in start_clipper
    self._start_redis()
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/clipper_admin/kubernetes/kubernetes_container_manager.py", line 281, in _start_redis
    namespace=self.k8s_namespace)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/api/extensions_v1beta1_api.py", line 174, in create_namespaced_deployment
    (data) = self.create_namespaced_deployment_with_http_info(namespace, body, **kwargs)  # noqa: E501
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/api/extensions_v1beta1_api.py", line 265, in create_namespaced_deployment_with_http_info
    collection_formats=collection_formats)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/api_client.py", line 345, in call_api
    _preload_content, _request_timeout)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/api_client.py", line 176, in __call_api
    _request_timeout=_request_timeout)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/api_client.py", line 388, in request
    body=body)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/rest.py", line 278, in POST
    body=body)
  File "/Users/marclipoff/anaconda3/envs/clipper_test/lib/python3.6/site-packages/kubernetes/client/rest.py", line 231, in request
    raise ApiException(http_resp=r)
kubernetes.client.rest.ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Type': 'application/json', 'Date': 'Tue, 12 May 2020 18:22:06 GMT', 'Content-Length': '174'})
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"the server could not find the requested resource","reason":"NotFound","details":{},"code":404}