Skip to content

Conversation

@pawosm-arm
Copy link
Contributor

Initial upstream attempt: llvm/llvm-project#126527

Downstream issue: #177

There are some test cases which tend to fail with timeout when started on heavy loaded shared machines. As our CI machines are mostly shared, those failures tend to introduce unnecessary disturbance to our work. It is better to disable those tests.

For more context, please read issue #177.

…upported

Initial upstream attempt: llvm/llvm-project#126527

Downstream issue: #177

There are some test cases which tend to fail with timeout when
started on heavy loaded shared machines. As our CI machines are
mostly shared, those failures tend to introduce unnecessary
disturbance to our work. It is better to disable those tests.

For more context, please read issue #177.
Copy link
Contributor

@dcandler dcandler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure we should use a downstream change to disable the tests for everyone if it's a problem that only affects our CI because we're knowingly overloading the machines.

Do we have to modify the sources to not run these tests in our builds? Lit provides the option to filter out tests either by the command line or environment variable (https://llvm.org/docs/CommandGuide/lit.html#cmdoption-lit-filter-out). Could that not be used to skip the tests in our CI, at the point when tests are run?

@pawosm-arm
Copy link
Contributor Author

pawosm-arm commented Mar 7, 2025

@dcandler I need your advice here. If we start the tests like this:

ninja -j${PARALLEL_JOBS} check-all

how can I pass the --filter-out parameter to lit from here?

@dcandler
Copy link
Contributor

dcandler commented Mar 7, 2025

how can I pass the --filter-out parameter to lit from here?

I don't think you can, which is why the LIT_FILTER_OUT environment variable is also provided for exactly this situation. Set the tests to be filtered out there, then then subsequent ninja check-all won't run them.

@pawosm-arm
Copy link
Contributor Author

Closing it as we really don't want to introduce a downstream change.

@pawosm-arm pawosm-arm closed this Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants