Depends and DependsExternal issues

[oojacoboo]

So, I'm unable to figure out how to get paratest/phpunit to order tests in such a way that Depends and DependsExternal don't cause tests to be skipped because they depend on these tests to pass.

I have the phpunit.xml config executionOrder set to depends,random.

Is there a trick to getting this working properly? Or is paratest unable to properly order the tests such that dependencies can be properly used?

[Jean85]

Paratest by default parallelizes by TestCase class, so I might imagine that you have dependencies between multiple TestCases... This is not a feasible workflow, IMHO. If you have tests with dependencies, running them in parallel will always create problems for you, because with parallelism you will never know if your dependency completed its run before you start...

[oojacoboo]

Yep, that's basically been my conclusion - can't use DependsExternal. Which is pretty unfortunate and means you need to execute logic multiple times, essentially.

Depends should work though, since tests should be prioritized based on dependencies per class, correct?

[Slamdunk]

#[Depends] should work just fine.

Until now I didn't even know #[DependsExternal] exists: in theory we can force 2 TestCases to run in the same process, but honestly that'd be a lot of work for something that has never been requested in all these years...

Any PR is welcome

[oojacoboo]

It hasn't been requested because it's new. But it replaces the old annotation style @depends which worked with "external" dependencies. I thought those were working. We recently upgraded to 11.x though, and all of these tests are broken.