• cylc cat-log --mode=list-dir <job-id> reports the log files that are present for a given job.
• If the job is running, it looks at the remote filesystem.
• If the job is finished, it looks at the local filesystem (providing that job log retrieval is configured).

Issues:

1. There is a lag between a job finishing and job log retrieval being performed.
2. Sometimes not all log files are retrieved due to files exceeding the maximum configured size, or possibly retrieval errors.

Solution:

• If the job is finished, but the job.out file is not present, perform the listing on the remote platform.

Note:

• We use the presence of the job.out file to indicate the success of job log retrieval:

  cylc-flow/cylc/flow/task_events_mgr.py

  Line 1215 in 0e738b4

  fnames = [JOB_LOG_OUT]

• This helps to reduce the caveats of removing the --force-remote option from the UI Server's use of cylc cat-log --mode=list-dir: Allow configuration to tell cat-log to fetch logs from (local) disk rather than remote host cylc-uiserver#506