Skip to content

ci: Reduce build matrix size#292

Draft
kennylevinsen wants to merge 17 commits intocage-kiosk:masterfrom
kennylevinsen:simplerci
Draft

ci: Reduce build matrix size#292
kennylevinsen wants to merge 17 commits intocage-kiosk:masterfrom
kennylevinsen:simplerci

Conversation

@kennylevinsen
Copy link
Contributor

@kennylevinsen kennylevinsen commented Nov 22, 2023

Significantly reduce the build matrix size for simpler results and less build scheduling latency. Drops multi-compiler tests.

Based on the 0.17 update branch because of a minor conflict it will create.

@joggee-fr
Copy link
Collaborator

I don't understand why it is an issue to test multiple compilers with CI. It seems on the contrary a good test to do.

@kennylevinsen
Copy link
Contributor Author

Minor rant about test strategies:

Adding anything possible is not a good test strategy, and more tests are not itself better than fewer as they are a liability and add noise (the more indicators, the less each one means), test time (either per run or in scheduling and full test completion), and maintenance (minor here, but still a factor) that should be justified. Focus should be on adding tests that are expected to add value and cover new areas or known problem areas.

Testing clang vs. gcc tells us very little. It does not test for distro or OS build environment compatibility, as each OS and distro use different compiler versions, library versions and configurations. With that in mind it just seemed like noise to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments