Error starting recorded run #165
Description
I don't have a repeatable test case, but I have seen this intermittently during testing. It seems that the container has been removed before we hit the wait? Maybe remove=False and container.remove() would fix it?
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 412, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/girder_worker/task.py", line 148, in __call__
results = super(Task, self).__call__(*_t_args, **_t_kwargs)
File "/usr/local/lib/python3.8/dist-packages/celery/app/trace.py", line 704, in __protected_call__
return self.run(*args, **kwargs)
File "/gwvolman/gwvolman/tasks.py", line 723, in recorded_run
tag = image_builder.get_tag()
File "/gwvolman/gwvolman/build_utils.py", line 126, in get_tag
ret, output_digest = self.run_r2d(
File "/gwvolman/gwvolman/build_utils.py", line 207, in run_r2d
ret = container.wait()
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 512, in wait
return self.client.api.wait(self.id, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1304, in wait
return self._result(res, True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.28/containers/726c5d9b0849a007f87cad7d4ee33de62e7b1f3463e8d54f2aed2af2f278e690/wait: Not Found ("No such container: 726c5d9b0849a007f87cad7d4ee33de62e7b1f3463e8d54f2aed2af2f278e690")