Skip to content

Added 24h default time limit #156

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
trz42 merged 6 commits into from
Mar 10, 2023
Merged

Added 24h default time limit #156

Changes from 2 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
c2cc287
Added 24h default time limit
jonas-lq Feb 28, 2023
e9169f4
Fixed whitespace to be pep8 compliant
jonas-lq Feb 28, 2023
78ecdb8
Added checks for short and long form of time flag
jonas-lq Mar 6, 2023
2e2abc9
Added whitespace around operator
jonas-lq Mar 6, 2023
3fbc97a
Catching more cases in the time limit check
jonas-lq Mar 9, 2023
8bf9b1a
Code polishing
jonas-lq Mar 10, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions tasks/build.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -265,12 +265,19 @@ def submit_job(job, submitted_jobs, build_env_cfg, ym, pr_id):
- symlink(string): symlink from main pr_<ID> dir to job dir (job[0])
"""

# Add a default time limit of 24h to the command if nothing else is specified by the user
if "--time=" not in build_env_cfg[SLURM_PARAMS]:
time_limit = "--time=24:00:00"
else:
time_limit = ""

Copy link
Contributor

@trz42 trz42 Mar 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This would work only if a limit is specified via the setting slurm_params in app.cfg and if the notation with = is used. The sbatch command also allows to provide values with a space, i.e., --time SOME_LIMIT and the short form -t SOME_LIMIT.

Copy link
Contributor

@trz42 trz42 Mar 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The test should include job.slurm_opts (which are read from arch_target_map in app.cfg).

# determine CPU target to use: job.arch_target, but without the linux/ part
cpu_target = '/'.join(job.arch_target.split('/')[1:])

command_line = ' '.join([
build_env_cfg[SUBMIT_COMMAND],
build_env_cfg[SLURM_PARAMS],
time_limit,
job.slurm_opts,
# set $CPU_TARGET in job environment, which can be picked up by build job script;
'--export=ALL,CPU_TARGET=%s' % cpu_target,
Expand Down