Skip to content

Commit 3f8705a

Browse files
Bump max launch workers (#720)
1 parent da85235 commit 3f8705a

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

model-engine/model_engine_server/common/resource_limits.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,7 @@
1818
parse_mem_request,
1919
)
2020

21-
MAX_ENDPOINT_SIZE = (
22-
50 # This may be a bit strict, but for now it feels reasonable, since 250 workers is too much
23-
)
21+
MAX_ENDPOINT_SIZE = 250 # Bumped max-size from 50 to 250 to support robotics
2422
# Also note that this is the default max_workers value for batch tasks.
2523
# Separately, we need user compute limits
2624
MAX_ASYNC_CONCURRENT_TASKS = 20 # Empirically, with prefork workers, the celery forwarder can only handle 20 concurrency as of Dec 2024

0 commit comments

Comments
 (0)