Skip to content

Add Batch routing support via @service_endpoint with configurable batch size and timeout#304

Open
DNXie wants to merge 6 commits intometa-pytorch:mainfrom
DNXie:batch_router
Open

Add Batch routing support via `@service_endpoint` with configurable batch size and timeout#304
DNXie wants to merge 6 commits intometa-pytorch:mainfrom
DNXie:batch_router

Commits

Commits on Oct 3, 2025

Commits on Oct 6, 2025

Commits on Oct 7, 2025

Commits on Oct 8, 2025