Skip to content

Commit 42f2271

Browse files
committed
update
1 parent 86cbf86 commit 42f2271

File tree

7 files changed

+1393
-126
lines changed

7 files changed

+1393
-126
lines changed

src/inference_endpoint/commands/benchmark/execute.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -488,6 +488,10 @@ def run_benchmark(config: BenchmarkConfig, test_mode: TestMode) -> None:
488488
type(config).__name__,
489489
config.model_dump_json(indent=2, exclude_none=True),
490490
)
491+
from inference_endpoint.async_utils.runner import run_async
492+
493+
from .execute_async import run_benchmark_async
494+
491495
ctx = setup_benchmark(config, test_mode)
492-
report, collector = run_benchmark_threaded(ctx)
496+
report, collector = run_async(run_benchmark_async(ctx))
493497
finalize_benchmark(ctx, report, collector)

0 commit comments

Comments
 (0)