Commit 78ac50f
committed
test/extended/cli/adm_upgrade/recommend: Allow Failing!=False
A depressing amount of the time in single-node testing, the
authentication ClusterOperator is Available=False, and causes the
'recommend' command to error if the 'Failing' risk is not accepted.
For example, in this aggregation run's 20 attempts [1]:
* 9 passed.
* three failed the '--version' test-case on 'authentication' 'Available=False' [2,3,4].
* two failed on build-cluster registry 500s [5,6].
* two failed on 'prometheus-operator' watch requests [7,8].
* one failed on a 'context deadline exceeded' out of
'runUpdateService' [9], with 'Failed to pull image...authentication
required' issues trying to get the 'tools' image.
* one failed on authentication Pod restarts [10].
* one failed on an un-excepted 'authentication' 'Available=False'
('OAuthServerDeployment_NoPod') [11].
* one failed on an unexpected successful return in an
TestImageStreamTagsAdmission test-case [12].
So the auth functionality is pretty flaky in these single-node
clusters under serial-suite load. Ideally [13] can get addressed or
the auth component can otherwise get firmed up, but until then, this
commit softens our logic to allow that kind of ClusterOperator
Available=False (which gets bubbled up as ClusterVersion
Failing=True), without failing our new test-case.
[1]: #30113 (comment)
[2]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055948225941504
[3]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055951426195456
[4]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055945973600256
[5]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055945063436288#1:build-log.txt%3A32
[6]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055945512226816#1:build-log.txt%3A43
[7]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055950948044800
[8]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055948683120640
[9]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055952327970816
[10]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055953233940480
[11]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055947772956672
[12]: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30113-nightly-4.21-e2e-aws-ovn-single-node-serial/1964055952797732864
[13]: https://issues.redhat.com/browse/OCPBUGS-200561 parent c68be5e commit 78ac50f
1 file changed
+2
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
240 | 240 | | |
241 | 241 | | |
242 | 242 | | |
243 | | - | |
| 243 | + | |
244 | 244 | | |
245 | 245 | | |
246 | 246 | | |
| |||
253 | 253 | | |
254 | 254 | | |
255 | 255 | | |
256 | | - | |
| 256 | + | |
257 | 257 | | |
258 | 258 | | |
259 | 259 | | |
| |||
0 commit comments