Skip to content

chore: improve production test runner on TeamCity#5350

Merged
zoobestik merged 5 commits intomasterfrom
e2e-tc-reporter
Feb 18, 2026
Merged

chore: improve production test runner on TeamCity#5350
zoobestik merged 5 commits intomasterfrom
e2e-tc-reporter

Conversation

@zoobestik
Copy link
Collaborator

@zoobestik zoobestik commented Feb 3, 2026

part of huge #5333

@zoobestik zoobestik force-pushed the e2e-tc-reporter branch 2 times, most recently from 5257b4f to 5630c9d Compare February 3, 2026 14:30
@zoobestik zoobestik requested a review from solarday February 3, 2026 14:34
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check how the order in which tests are run affects the closing of a cookie banner.

For example, if we run a test for a cookie banner, it should reset the previously saved state (when the banner was closed) and check that it exists. This means we'll save the state when the banner should be open.

If we then run another test where the banner should already be closed, will it pass?

@zoobestik zoobestik force-pushed the e2e-tc-reporter branch 2 times, most recently from d6d7f73 to b43d0dc Compare February 16, 2026 14:18
@zoobestik
Copy link
Collaborator Author

zoobestik commented Feb 16, 2026

🆙 Added banner test - order independence verified

What was done:

  • Added a test for the banner functionality
  • Verified that execution order does not affect test results

Testing approach: Tests were run in parallel with various interleavings to ensure independence:

  • Each test runs in its own isolated context (like an incognito session)
  • Tests were executed in different combinations (with/without cookies, reversed order)
  • Result: Each test operates independently - the presence/absence of banner messages in one test doesn’t affect others

/cc @solarday

@zoobestik zoobestik requested a review from solarday February 18, 2026 12:40
- Update retries, reporter, timeout, and forbidOnly logic
- Introduce dynamic configuration based on the development or CI mode
- Introduced global setup script for consistent cookie banner handling in production.
- Removed redundant cookie banner interaction logic from individual test files.
- Updated `.gitignore` to include `test/storage-state.json`.
- Removed the unused `isStaging` function from `utils.ts`.
- Replaced `isStaging` with `isProduction` in landings spec tests.
- Updated test skipping logic for reverse-proxy hosts.
@zoobestik zoobestik merged commit 57627f8 into master Feb 18, 2026
5 checks passed
@zoobestik zoobestik deleted the e2e-tc-reporter branch February 18, 2026 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants