Skip to content

Commit 6fec6cd

Browse files
authored
look back over fewer days by default, allow longer execution (#1517)
1 parent 533039e commit 6fec6cd

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

06_gpu_and_ml/llm-serving/vllm_throughput.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,7 @@
8484

8585

8686
@app.local_entrypoint()
87-
def main(lookback: int = 7, wait_for_results: bool = True):
87+
def main(lookback: int = 5, wait_for_results: bool = True):
8888
jobs = orchestrate.remote(lookback=lookback) # trigger remote job orchestration
8989

9090
if wait_for_results:
@@ -282,6 +282,7 @@ class Filing:
282282
@app.cls(
283283
image=vllm_image,
284284
gpu=GPU,
285+
timeout=10 * MINUTES,
285286
volumes={
286287
"/root/.cache/huggingface": hf_cache_vol,
287288
"/root/.cache/vllm": vllm_cache_vol,

0 commit comments

Comments
 (0)