Skip to content

v4.3.1

Choose a tag to compare

View all tags
@sebrandon1 sebrandon1 released this 10 Jul 19:09
· 1823 commits to main since this release
v4.3.1
e6f6382
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

The v4.3.1 release of the CNF Certification Test Suite contains a number of changes all sorted below.

The most notable changes are:

  • Using the all flag when specifying which test suites to run. Users will no longer have to specify certain suites (common,extended,faredge,telco) to run all tests. See #1176.
  • By default now all results files will be placed into a tar.gz bundle after each test run. See #1200 for more details.
  • You can now supply a pre-defined feedback.json to the HTML parser to help with auto-filling response text boxes. See #1213.
  • The CNF Best Practices repo now links directly to-and-from the CATALOG.md. See #1185.

Catalog Improvements

Results Parser Changes

Tests Added

Tests Updated / Improved

  • check that helm version is v3 by @aabughosh in #1103
  • Adding error text to the abort suite message by @edcdavid in #1163
  • CNFCERT-495 : performance refactor code by @bnshr in #1161
  • Adjust the PDB test by @sebrandon1 in #1155
  • Add a single label for running ALL tests instead of having to choose individual labels by @aabughosh in #1176
  • Fix checking semver version against contraint version by @edcdavid in #1195
  • Fix empty service account check by @bnshr in #1197
  • Fix network policy tests with empty podSelector by @javierpena in #1147
  • Fix for hardcoded registry registry.redhat.io by @edcdavid in #1187
  • Add emptystring test case for getIPVersion() by @sebrandon1 in #1211
  • CNFCERT-541 : Make Pod Role Bindings fail with default service account by @bnshr in #1210
  • Fix for the unstable test cases of the performance test suite. by @greyerof in #1226

Failure-Reason Objects

To take better advantage of our new compliant/non-compliant reporting objects in the HTML parser, we have added support for the reporting objects in all of the existing tests.

CI Improvements

Dependency Updates

  • Bump github.com/stretchr/testify from 1.8.3 to 1.8.4 by @dependabot in #1141
  • Update preflight to v1.6.4 by @sebrandon1
  • Bump github.com/onsi/ginkgo/v2 from 2.9.5 to 2.9.7 by @dependabot in #1146
  • Bump github.com/operator-framework/api from 0.17.5 to 0.17.6 by @dependabot in #1148
  • Update operator-sdk to v1.29.0 by @sebrandon1 in #1149
  • Update RHCOS to OCP version map by @github-actions in #1151
  • Update RHCOS to OCP version map by @github-actions in #1153
  • Bump github.com/sirupsen/logrus from 1.9.2 to 1.9.3 by @dependabot in #1154
  • Update GolangCI to 1.53.2 by @sebrandon1 in #1156
  • Update RHCOS to OCP version map by @github-actions in #1158
  • Update preflight to v1.6.5 by @sebrandon1 in #1157
  • Bump github.com/onsi/ginkgo/v2 from 2.9.7 to 2.10.0 by @dependabot in #1159
  • Update RHCOS to OCP version map by @github-actions in #1160
  • Update Go to v1.20.5 by @sebrandon1 in #1165
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.19 to 1.0.20 by @dependabot in #1166
  • Bump github.com/test-network-function/privileged-daemonset from 1.0.3 to 1.0.4 by @dependabot in #1167
  • Update RHCOS to OCP version map by @github-actions in #1168
  • Update preflight to v1.6.6 by @sebrandon1 in #1170
  • Update RHCOS to OCP version map by @github-actions in #1174
  • Bump k8s.io/kubectl from 0.27.2 to 0.27.3 by @dependabot in #1179
  • Bump k8s.io/apiextensions-apiserver from 0.27.2 to 0.27.3 by @dependabot in #1181
  • Bump helm.sh/helm/v3 from 3.12.0 to 3.12.1 by @dependabot in #1183
  • Update RHCOS to OCP version map by @github-actions in #1188
  • Bump github.com/onsi/ginkgo/v2 from 2.10.0 to 2.11.0 by @dependabot in #1190
  • Bump github.com/test-network-function/privileged-daemonset from 1.0.4 to 1.0.5 by @dependabot in #1192
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.20 to 1.0.21 by @dependabot in #1193
  • Update RHCOS to OCP version map by @github-actions in #1196
  • Update preflight to v1.6.7 by @sebrandon1 in #1194
  • Update RHCOS to OCP version map by @github-actions in #1203
  • Update preflight to v1.6.9 by @sebrandon1 in #1204
  • Update RHCOS to OCP version map by @github-actions in #1208
  • Update RHCOS to OCP version map by @github-actions in #1235
  • Update preflight to v1.6.10 by @sebrandon1 in #1234
  • Update GolangCI-lint to v1.53.3 by @sebrandon1 in #1236
  • Update operator-sdk to v1.30.0 by @sebrandon1 in #1212
  • Update RHCOS to OCP version map by @github-actions in #1221
  • Update RHCOS to OCP version map by @github-actions in #1224
  • Update RHCOS to OCP version map by @github-actions in #1230

Quality of Life

QE Updates

  • Updated qe boolean for recently automated tests by @theemj in #1152
  • QE Coverage : Add more details in result by @bnshr in #1173
  • Mark manageability tests as implemented by @bnshr in #1172
  • Mark access-control tests as implemented by @bnshr in #1189
  • Mark pod-role-binding as QE test implemented by @bnshr in #1198
  • Mark cluster-role-bindings as QE test covered by @bnshr in #1217
  • Set QE flag for the test hugepages-1g-only (platform-alteration) by @jmontesi in #1225
  • Set the QE coverage flag for the test case one-process-per-container by @jmontesi in #1231

New Contributors

Full Changelog: v4.3.0...v4.3.1

Contributors

rdavid, sebrandon1, and 8 other contributors
Assets 2
Loading