Skip to content

Commit 55597b1

Browse files
committed
temporarily disable kuttl-v1 tests
kuttl-v1 is currently the slowest and flakiest of our test suites. As the majority of changes made aren't even exercised by this suite, it's being disabled until we can make time to deflake and speed it up. This test alone is responsible for ~48 hours of wasted time during this last release cycle. (cherry picked from commit 75e78c7) # Conflicts: # .buildkite/testsuite.yml # gen/pipeline/pipeline.go
1 parent de7fc47 commit 55597b1

File tree

2 files changed

+9
-48
lines changed

2 files changed

+9
-48
lines changed

.buildkite/testsuite.yml

Lines changed: 0 additions & 42 deletions
Original file line numberDiff line numberDiff line change
@@ -149,48 +149,6 @@ steps:
149149
context: acceptance
150150
report-slowest: 10
151151
soft_fail: true
152-
- group: Kuttl-V1 Tests
153-
key: kuttl-v1
154-
steps:
155-
- agents:
156-
queue: k8s-m6id12xlarge
157-
command: ./ci/scripts/run-in-nix-docker.sh task ci:configure ci:test:kuttl-v1
158-
key: kuttl-v1-run
159-
label: Run Kuttl-V1 Tests
160-
notify:
161-
- github_commit_status:
162-
context: Kuttl-V1 Tests
163-
plugins:
164-
- github.com/seek-oss/aws-sm-buildkite-plugin#v2.3.2:
165-
json-to-env:
166-
- secret-id: sdlc/prod/buildkite/github_api_token
167-
- secret-id: sdlc/prod/buildkite/redpanda_sample_license
168-
- secret-id: sdlc/prod/buildkite/redpanda_second_sample_license
169-
- secret-id: sdlc/prod/buildkite/slack_vbot_token
170-
- https://$GITHUB_API_TOKEN@github.com/redpanda-data/step-slack-notify-buildkite-plugin.git#main:
171-
channel_name: kubernetes-tests
172-
conditions:
173-
branches:
174-
- main
175-
failed: true
176-
message: ':cloud: Kuttl-V1 Tests Job Failed'
177-
slack_token_env_var_name: SLACK_VBOT_TOKEN
178-
soft_fail: true
179-
timeout_in_minutes: 90
180-
- continue_on_failure: true
181-
wait: null
182-
- agents:
183-
queue: pipeline-uploader
184-
allow_dependency_failure: true
185-
command: ""
186-
key: kuttl-v1-parse
187-
label: Parse and annotate Kuttl-V1 Tests results
188-
plugins:
189-
- github.com/buildkite-plugins/junit-annotate-buildkite-plugin#v2.4.1:
190-
artifacts: work/operator/tests/_e2e_artifacts/kuttl-report.xml
191-
context: kuttl-v1
192-
report-slowest: 10
193-
soft_fail: true
194152
- group: Kuttl-V1-Nodepools Tests
195153
key: kuttl-v1-nodepools
196154
steps:

gen/pipeline/pipeline.go

Lines changed: 9 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -44,12 +44,15 @@ var suites = []TestSuite{
4444
Required: false,
4545
Timeout: time.Hour,
4646
},
47-
{
48-
Name: "kuttl-v1",
49-
Required: false,
50-
Timeout: 30*time.Minute + time.Hour,
51-
JUnitPattern: ptr.To("work/operator/tests/_e2e_artifacts/kuttl-report.xml"),
52-
},
47+
// kuttl-v1 is currently the slowest and flakiest of our test suites. The
48+
// majority of changes made aren't exercised by this suite. It's disabled
49+
// until we have time to speed it up and deflake it.
50+
// {
51+
// Name: "kuttl-v1",
52+
// Required: true,
53+
// Timeout: 30*time.Minute + time.Hour,
54+
// JUnitPattern: ptr.To("work/operator/tests/_e2e_artifacts/kuttl-report.xml"),
55+
// },
5356
{
5457
Name: "kuttl-v1-nodepools",
5558
Required: true,

0 commit comments

Comments
 (0)