Investigate into flaky tests once we move testing platforms

[AlexFenlon]

prerequisite - #8411

Look into why some flaky tests are failing, retest every test that uses the pytest marker @pytest.mark.flaky when we switch to a different k8s platform for testing

See if the test is reproducable and figure out why each test is failing to see if it now passes with the new platform

[github-actions]

Hi @AlexFenlon thanks for reporting!

Be sure to check out the docs and the Contributing Guidelines while you wait for a human to take a look at this 🙂

Cheers!