Skip to content

Conversation

pohly
Copy link
Contributor

@pohly pohly commented Sep 29, 2025

The experiment is meant to determine whether running serial tests in the same job as the parallel tests works and how much slower it becomes.

Even long term the job probably shouldn't be release informing because the alpha tests can break it at any time, without affecting the release. What needs to become release informing instead are the kind-alpha-beta-enabled and/or kind-alpha-beta-enabled-conformance jobs (to be determined after we are done with setting everything up and they proof to be stable).

/assign @aojea
/cc @BenTheElder

From Slack:

do we already have guarantee the Serial decorator to make the behavior to run after the parallel tests? do we know it is working correctly?

[...]So that part should work. But you are right, we haven't really exercised that much. [...] Looking at my list I don't see any canaries for ci jobs. [...] Modifying ci-kubernetes-e2e-kind-alpha-beta-features instead of creating a new periodic seems safe enough.

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. area/config Issues or PRs related to code in /config size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. area/jobs sig/testing Categorizes an issue or PR as relevant to SIG Testing. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Sep 29, 2025
@pohly pohly force-pushed the alpha-beta-serial branch from 1e85b85 to 21706a7 Compare October 7, 2025 08:44
@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Oct 7, 2025
@pohly
Copy link
Contributor Author

pohly commented Oct 7, 2025

Because of kubernetes/sig-release#2888 I decided to not modify the existing job and instead added another one.

…slow)

The experiment is meant to determine whether running serial tests in the same
job as the parallel tests works, how much slower it becomes, and how stable
the job is (hence periodic).

Slow, deprecated and disruptive tests are also allowed. The goal is full coverage.
@pohly pohly force-pushed the alpha-beta-serial branch from 21706a7 to ef9be07 Compare October 7, 2025 08:52
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Oct 7, 2025
@aojea
Copy link
Member

aojea commented Oct 7, 2025

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Oct 7, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: aojea, pohly

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 7, 2025
@k8s-ci-robot k8s-ci-robot merged commit 947c063 into kubernetes:master Oct 7, 2025
6 checks passed
@k8s-ci-robot
Copy link
Contributor

@pohly: Updated the job-config configmap in namespace default at cluster test-infra-trusted using the following files:

  • key kubernetes-kind-ci.yaml using file config/jobs/kubernetes/sig-testing/kubernetes-kind-ci.yaml

In response to this:

The experiment is meant to determine whether running serial tests in the same job as the parallel tests works and how much slower it becomes.

Even long term the job probably shouldn't be release informing because the alpha tests can break it at any time, without affecting the release. What needs to become release informing instead are the kind-alpha-beta-enabled and/or kind-alpha-beta-enabled-conformance jobs (to be determined after we are done with setting everything up and they proof to be stable).

/assign @aojea
/cc @BenTheElder

From Slack:

do we already have guarantee the Serial decorator to make the behavior to run after the parallel tests? do we know it is working correctly?

[...]So that part should work. But you are right, we haven't really exercised that much. [...] Looking at my list I don't see any canaries for ci jobs. [...] Modifying ci-kubernetes-e2e-kind-alpha-beta-features instead of creating a new periodic seems safe enough.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@pohly pohly changed the title kind-alpha-beta-features: not release informing, serial experiment kind-alpha-beta-features: serial experiment Oct 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/jobs cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants