Flaky failures for UserControllerMockTest during reconcilation

[Vaibhav-Nazare]

Hi @scholzj

We have been facing this issue for a while where we have random flaky failures among due to timeout.

io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[1]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[2]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[3]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithRuntimeErrorStatusUpdate

Following are flaky failures occurred for every run

Test 1:- http://140.211.168.45:8080/job/strimzi-kafka-operator/job/strimzi-kafka-operator-fork/16/consoleText

io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[1]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[3]

Test 2:- http://140.211.168.45:8080/job/strimzi-kafka-operator/job/strimzi-kafka-operator-fork/18/consoleText
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[2]

Test 3:- http://140.211.168.45:8080/job/strimzi-kafka-operator/job/strimzi-kafka-operator-fork/19/consoleText

io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[1]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[2]
io.strimzi.operator.user.UserControllerMockTest.testReconciliationWithClientErrorStatusUpdate(int, String)[3]

Can you suggest us something here?

[scholzj]

TBH, I have not seen this test as flaky anywhere else.

[Vaibhav-Nazare]

Any pointers what should we look into?

[scholzj]

I'm not sure. Some of the Mock based tests are flaky. But I never saw it with the User OPerator. Always only with the Cluster Operator. So I have absolutely no idea.

[im-konge]

I tried it locally and those tests are flaky for me as well

I will try to debug it more

[Vaibhav-Nazare]

@im-konge Any further updates on this?

[im-konge]

Not yet, as I mentioned, those tests fail for me as well, but I didn't fix them yet. I will keep you posted.