Skip to content

Commit c146fca

Browse files
committed
fix
Signed-off-by: oliver könig <okoenig@nvidia.com>
1 parent 7c59169 commit c146fca

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

nemo_run/core/execution/dgxcloud.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -391,6 +391,10 @@ def fetch_logs(
391391
stderr: Optional[bool] = None,
392392
stdout: Optional[bool] = None,
393393
) -> Iterable[str]:
394+
while self.status(job_id) != DGXCloudState.RUNNING:
395+
logger.info("Waiting for job to start...")
396+
time.sleep(15)
397+
394398
cmd = ["tail"]
395399

396400
if stream:

0 commit comments

Comments
 (0)