Skip to content

Change integration test to run only on static components by default#225

Merged
jamesiri merged 1 commit intoclearlydefined:mainfrom
qtomlinson:qt/update-test-default
Feb 13, 2026
Merged

Change integration test to run only on static components by default#225
jamesiri merged 1 commit intoclearlydefined:mainfrom
qtomlinson:qt/update-test-default

Conversation

@qtomlinson
Copy link
Collaborator

@qtomlinson qtomlinson commented Feb 12, 2026

There are two ways to run the integaration test:

  • static coordinates: Harvest against a predefined, production-comparable set. Deterministic and repeatable; best for catching regressions and breaking changes.

  • dynamic coordinates: Harvest against a dynamically generated set. Useful for exploratory testing and sampling; results vary and need to look into the differences between dev and production deployment case by case.

This PR changes the default of the action to run the static (known-good) path to reliably detect breaking changes. User can still enable dynamic mode (via input following the example in the description) when exploring behavior or sampling broader coverage.

@qtomlinson qtomlinson marked this pull request as ready for review February 12, 2026 18:06
@jamesiri jamesiri merged commit 699800b into clearlydefined:main Feb 13, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants