-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Remove Node.js self.run_js() test in browser suite. #25473
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
… should test browser behavior only.
Is there some particular reason you want to remove this? Did it causes issues somehow? |
The rationale is that it prevents testing the said configuration. And given it looks redundant, I thought rather simpler to remove it, than to have a manual test skip. Is there anything relevant that this code tests that isn't tested elsewhere? |
Can you explain this? |
I am setting the environment variable
before running so that all the tests would focus on verifying that MIN_FIREFOX_VERSION is accurate to the target Firefox version. But because the one test That one line is the only outlier in the whole |
Oh I think I see. We set Maybe you could do that same in your CI? Or if not then maybe also remove the |
I get this issue in all the |
I do already pass |
Do you need to inject this flag? It seems like that would mean you are testing a slightly different configuration than the one the test suite it setup for, no? Why not just leave |
The idea is to improve test coverage by setting flags that only target Firefox. It should be a valid combination of configuration for end users to pass, so "why are you testing that. Don't do it" doesn't seem a good resolution. |
Is specifying |
No, because there is also The reason I am only enabling Firefox in the test run is to make sure that supporting some other environment does not accidentally mask and enable a feature, that would hide a bug with the minimum version levels for Firefox (like e.g. in #25465) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure I understand. |
Yeah that's what I was confused about.. I was not sure if it includes node or not.. but probably not. |
@kripken would this be ok to land? The deleted block of code is an oddity in the browser suite: it verifies behavior in the Node.js shell rather than the browser. To my eyes, the deleted code amounts to verifying that
works. That doesn't seem like anything special/relevant? We do have a lot of tests for --preload-file in the By deleting that code, I can run the
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you also remove the corresponding EMTEST_SKIP_NODE_CANARY
entries from the test-browser-*
tasks in .circleci/config.yml
?
Hmm how do you mean? I don't see a reference to |
I'm not sure if this PR will necessarily allow removing |
We currently set |
Oh I see, that was the only test remaining in browser suite that had the canary part. |
Remove Node.js self.run_js() test in browser suite. The browser suite should test browser behavior only.
I am running the browser suite with
to verify that targeting Firefox only should correctly result in a build that works in Firefox.
The test
test_hello_world_worker
is the only one that failed. Which happens because that test also verifies behavior in node.js.Reading the test logic in that test, it seems to verify the file packager and
emscripten_run_script()
logic. That logic should be well covered in thecore
test suites and theother
test suite already, so this seems redundant.