-
Notifications
You must be signed in to change notification settings - Fork 6
Description
There is a performance test for CompoundGenerator.prepare, that checks prepare runs in "reasonable" time when given a "unified" set of generators with sizes that multiply to 200 million points.
It's useful to keep an eye on the run time of this test, and keep the time limit quite tight, as if the startup for CompoundGenerator is too slow for large scans it undermines the effort made in #22 and its easy to negatively affect it (for instance, commit 3de9d66 in #24 added ~2 seconds to this test for a 30% increase in run time).
But the run times on travis are far too inconsistent for a tight bound, and builds are prone to the odd failure, particularly at peak times.
Do we want to keep the test or remove it? Do we want to relax the time limit? Or do we want to do some weird hacks for Travis, say applying the tighter limits for a workstation, but not for Travis VMs?