-
Notifications
You must be signed in to change notification settings - Fork 5
Description
Been hammering CI today, and saw a new flake. Never seen this one fail before, but it does appear to be just another slow startup issue (sleep is only 0.1). So lets leave it for now, if it comes up again we can add rerun backoff behavior
Test execution Flake
``` =================================== FAILURES =================================== ____________________________ test_execution_summary ____________________________temp_output_dir = '/private/var/folders/2z/bks_gyyd7g1g0kj25ltpgjwm0000gn/T/pytest-of-runner/pytest-0/test_execution_summary0/'
def test_execution_summary(temp_output_dir: str) -> None:
assert (
run_duct_command(
["sleep", "0.1"],
sample_interval=0.05, # small enough to ensure we collect at least 1 sample
report_interval=0.1,
output_prefix=temp_output_dir,
)
== 0
)
with open(os.path.join(temp_output_dir, SUFFIXES["info"])) as info:
info_dict = json.loads(info.read())
execution_summary = info_dict["execution_summary"]
# Since resources used should be small lets make sure values are roughly sane
assert execution_summary["average_pmem"] < 10
E TypeError: '<' not supported between instances of 'NoneType' and 'int'
test/duct_main/test_execution.py:92: TypeError
------------------------------ Captured log call -------------------------------
INFO con-duct:duct_main.py:112 duct 0.19.0.post42+ga689887 is executing 'sleep 0.1'...
INFO con-duct:duct_main.py:113 Log files will be written to /private/var/folders/2z/bks_gyyd7g1g0kj25ltpgjwm0000gn/T/pytest-of-runner/pytest-0/test_execution_summary0/
INFO con-duct:duct_main.py:186 Summary:
Exit Code: 0
Command: sleep 0.1
Log files location: /private/var/folders/2z/bks_gyyd7g1g0kj25ltpgjwm0000gn/T/pytest-of-runner/pytest-0/test_execution_summary0/
Wall Clock Time: 0.113 sec
Memory Peak Usage (RSS): -
Memory Average Usage (RSS): -
Virtual Memory Peak Usage (VSZ): -
Virtual Memory Average Usage (VSZ): -
Memory Peak Percentage: -%
Memory Average Percentage: -%
CPU Peak Usage: -%
Average CPU Usage: -%
=========================== short test summary info ============================
FAILED test/duct_main/test_execution.py::test_execution_summary - TypeError: '<' not supported between instances of 'NoneType' and 'int'
======== 1 failed, 343 passed, 2 skipped, 12 rerun in 151.81s (0:02:31) ========
py: exit 1 (153.45 seconds) /Users/runner/work/duct/duct> pytest -vv --cov-report=xml test pid=59968
py: FAIL code 1 (260.67=setup[107.22]+cmd[153.45] seconds)
evaluation failed :( (260.77 seconds)
Error: Process completed with exit code 1.
</details>