Skip to content

Comments

tests: Bump integration timeout to 40 minutes#538

Closed
RafalKorepta wants to merge 1 commit intomainfrom
rk/bump-integration-timeout
Closed

tests: Bump integration timeout to 40 minutes#538
RafalKorepta wants to merge 1 commit intomainfrom
rk/bump-integration-timeout

Conversation

@chrisseto
Copy link
Contributor

Looks like there's an actual root cause here. These logs are all present in the linked failures:

controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="766a841d-8635-4379-9392-97e3098e5032"
--
  | controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="f4c29a2e-fb95-46f5-94c3-8c591f10ef74"
  | controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="fff64c84-d8bf-493e-9877-cf2028bd8c00"
  | controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="09df12b7-4fac-4989-b095-3dd9acd46930"
  | controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="b24fe2a5-5477-49e3-bf78-1ee8d5d2b648"
  | controller.go:324: "msg"="Reconciler error" "error"="deploying *v1.Role: \"rp-9gd31r-sidecar-controllers\": roles.rbac.authorization.k8s.io \"rp-9gd31r-sidecar-controllers\" is forbidden: user \"system:serviceaccount:testenv-5kjk6:testenv-pzy3ce\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:testenv-5kjk6\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"coordination.k8s.io\"], Resources:[\"leases\"], Verbs:[\"create\" \"delete\" \"get\" \"list\" \"patch\" \"update\" \"watch\"]}" "controller"="redpanda" "controllerGroup"="cluster.redpanda.com" "controllerKind"="Redpanda" "Redpanda"={"name"="rp-9gd31r" "namespace"="testenv-5kjk6"} "namespace"="testenv-5kjk6" "name"="rp-9gd31r" "reconcileID"="559fcfdf-042a-447d-8475-fc2baddcab0e"

The tests likely timed out because we had something stuck in a wait loop while the above error was being logged over and over :/

@RafalKorepta RafalKorepta deleted the rk/bump-integration-timeout branch March 28, 2025 09:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants