Skip to content

Latest commit

 

History

History
36 lines (22 loc) · 3.08 KB

index.md

File metadata and controls

36 lines (22 loc) · 3.08 KB

Queue and Scheduling Policy

General Policy

We ask that all users follow good etiquette and be excellent to one another.

Priority

As with all Argonne Leadership Computing Facility production systems, job priority in the queue is based on several criteria:

  • Positive balance of your project
  • Size (in nodes) of the job; larger jobs receive higher priority
  • The type of project (e.g., INCITE, ALCC, or discretionary)
  • Job duration - shorter duration jobs will accumulate priority more quickly, so it is best to specify the job run time as accurately as possible

Reservations and Scheduling Policy

Some work will require use of the systems that necessitates deviation from regular policy. On such occasions, normal reservation policy applies. Please send the regular form no fewer than five (5) business days in advance.

Big Run Day (Aurora)

If you're running capability jobs and want to reduce turnaround time on Aurora, please submit your jobs to the prod queue by 6 p.m. (CT) each Sunday. ALCF will promote large, capability, non-overburn jobs as part of Big Run Day at the start of each week, giving all jobs in that queue a priority boost. While we expect this to occur weekly, there may be occasions when ALCF decides not to proceed, at our discretion.

Monday Maintenance

On select Mondays when the ALCF is on a regular business schedule, ALCF systems may undergo maintenance. The pbs_rstat command can be used to view pending and active maintenance reservations.

INCITE/ALCC Overburn Policy

If an INCITE or ALCC project has exhausted its allocation, it can still run jobs for the rest of the allocation year, but the jobs are often low priority.

  • The project can still run in the non-prod queues, such as debug.
  • For the first 11 months of its allocation year, it is eligible for overburn running. This means that capability jobs (20% of the machine) submitted to the prod queue will be routed to the regular queues until 125% of the project allocation has been consumed.
  • Otherwise, the prod queue routes the jobs to backfill queues, which have low priority. They are for active projects with a negative balance.

INCITE and ALCC projects needing additional overburn hours should email support@alcf.anl.gov with a short description of what they plan to do with the additional hours, highlighting specific goals or milestones and the time expected to accomplish them. This will be reviewed by the scheduling committee, allocations committee, and ALCF management. Requests should be submitted 15 days before the start of the next quarter of the allocation year for full consideration. Non-capability jobs (less than 20% of the machine) from projects that have exhausted their allocation will continue to run in backfill.

To be clear, this policy does not constitute a guarantee of extra time, and we reserve the right to prioritize the scheduling of jobs submitted by projects that have not yet used 100% of their allocations, so the earlier that an INCITE or ALCC project exhausts its allocation, the more likely it is to be able to take full advantage of this policy.