Skip to content

Conversation

@palfrey
Copy link
Member

@palfrey palfrey commented Jan 27, 2026

Description

We've seen a number of cases recently of workers being overwhelmed when a scheduler gets a large number of tasks. This adds a new property to worker configs (max_inflight_tasks) allowing for limiting the max tasks in flight on a worker. Default is unlimited tasks, which is the current behaviour.

Type of change

Please delete options that aren't relevant.

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

bazel test //...

Checklist

  • Updated documentation if needed
  • Tests added/amended
  • bazel test //... passes locally
  • PR is contained in a single commit, using git amend see some docs

This change is Reviewable

@palfrey palfrey marked this pull request as ready for review January 27, 2026 17:56
@amankrx
Copy link
Collaborator

amankrx commented Jan 27, 2026

/build-image

@github-actions
Copy link

Image built and pushed!

ghcr.io/TraceMachina/nativelink:a6607aa

@palfrey
Copy link
Member Author

palfrey commented Jan 28, 2026

/build-image nativelink-worker-init

@github-actions
Copy link

Image built and pushed!

ghcr.io/TraceMachina/nativelink-worker-init:a6607aa

@palfrey palfrey merged commit 1821bec into TraceMachina:main Jan 29, 2026
29 checks passed
@palfrey palfrey deleted the max-worker-tasks branch January 29, 2026 08:24
MarcusSorealheis added a commit to MarcusSorealheis/nativelink that referenced this pull request Jan 30, 2026
* 'main' of github.com:TraceMachina/nativelink:
  Release NativeLink v0.8.0 (TraceMachina#2128)
  Correct ignore handling for PlatformProperties (TraceMachina#2126)
  Add worker config option to limit maximum inflight tasks (TraceMachina#2125)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants