Skip to content

Conversation

@Kobzol
Copy link
Member

@Kobzol Kobzol commented Jul 6, 2025

This reverts #2161. I noticed that the recomputation logic has some issue on production, and it needlessly reruns stuff when a benchmark was restarted. Also the computation of step durations on the status page suffers when a benchmark is restarted, because we now restart steps, which is something the status page wasn't really prepared for.

The recomputation bug could be fixed, but now I think that we should merge this PR only after we have the new system, to avoid the problems with the step durations.

@Kobzol Kobzol requested a review from Mark-Simulacrum July 6, 2025 10:05
@Kobzol Kobzol changed the title Revert "Merge pull request #2161 from Kobzol/check-test-cases-with-measurements Revert #2161 Jul 6, 2025
@Kobzol
Copy link
Member Author

Kobzol commented Jul 6, 2025

For future reference: the bug can be reproduced with the Doc profile. The issue is that we think that e.g. Doc + IncrPatched is missing, while in reality it is never computed (even though it is a part of the profile x scenario matrix). We have to precompute/prefilter the matrix before checking DB.

…s-with-measurements"

This reverts commit f521c0a, reversing
changes made to b34ad29.
@Kobzol
Copy link
Member Author

Kobzol commented Jul 6, 2025

I just realized, if we revert this, and don't land #2188, then we'll be potentially skipping more test cases (because the old logic would just skip everything once). But it should always be at most one benchmark (crate) skipped, so hopefully that's still not so terrible.

@Kobzol
Copy link
Member Author

Kobzol commented Jul 6, 2025

Landing as a hotfix, it should help us make progress on the collector in the face of S3 upload failures.

@Kobzol Kobzol merged commit 1c64fa0 into rust-lang:master Jul 6, 2025
11 checks passed
@Kobzol Kobzol deleted the revert-2161 branch July 6, 2025 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants