Dynamic Tests Support

[breautek]

I see no mention of support for junit5 dynamic tests, so I assume it's not officially supported but I'm wondering if anyone got dynamic tests working in an instrumented test set using an activity.

I'm finding that once the @TestFactory returns, the test lifecycle seems to tears down and destroys the activity before the DynamicTest executors even run.

[breautek]

Kind of dumb, but I figured out why it behaves this way.

Junit5 Docs DynamicTest instances will be executed lazily) states that:

DynamicTest instances will be executed lazily

So inside the @TestFactory method, which is responsible for building out a list of dynamic tests, the dynamic test executor functions are not called immediately. They are called at an arbitrary point after the test factory method exits.

Even though the @TestFactory itself is not a test case, as far as the instrumentation runner is concerned it is. So once it exits, it will clean up resources like the activity scenario. It's not expecting additional tests to "magically appear" which is kind of how the test factory works.

Dynamic tests is still usable, but you have to make sure all activity usage is retained or occurs before the test factory exits, and the test executor functions cannot make use of the activity since they will fire after the junit test runner closes the activities. So this can be a bit limiting on how it can be used.