21
21
22
22
You can choose from four types of buckets:
23
23
24
- ``class ``
24
+ class
25
+ Tests from one class will never have tests from other classes or modules run in-between them.
25
26
26
- ``module ``
27
- the default setting
27
+ module
28
+ Tests will be shuffled within a module and modules will be shuffled, but tests from one module
29
+ will never be separated by tests from other modules.
30
+ **This is the default setting **.
28
31
29
- ``package ``
32
+ package
33
+ Same as above, but for package level. Note that modules (and hence tests inside those modules) that
34
+ belong to package ``x.y.z `` do not belong to package ``x.y ``, so they will fall in different buckets
35
+ when randomising with ``package `` bucket type.
30
36
31
- `` global ``
32
- all tests fall in the same bucket, full randomness, tests probably take longer to run
37
+ global
38
+ All tests fall in the same bucket, full randomness, tests probably take longer to run.
33
39
34
40
If you have three buckets of tests ``A ``, ``B ``, and ``C `` with three tests ``1 `` and ``2 ``, and ``3 `` in each of them,
35
41
then here are just two of many potential orderings that non-global randomisation can produce:
@@ -44,9 +50,6 @@ As you can see, all C tests are executed "next" to each other and so are tests i
44
50
Tests from any bucket X are guaranteed to not be interspersed with tests from another bucket Y.
45
51
For example, if you choose bucket type ``module `` then bucket X contains all tests that are in this module.
46
52
47
- Note that modules (and hence tests inside those modules) that belong to package ``x.y.z `` do not belong
48
- to package ``x.y ``, so they will fall in different buckets when randomising with ``package `` bucket type.
49
-
50
53
By default, your tests will be randomised at ``module `` level which means that
51
54
tests within a single module X will be executed in no particular order, but tests from
52
55
other modules will not be mixed in between tests of module X.
0 commit comments