Skip to content

Commit a9d4f7e

Browse files
pskiran1yinggeh
andauthored
Update protobuf/model_config.proto
Co-authored-by: Yingge He <[email protected]>
1 parent b08533e commit a9d4f7e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

protobuf/model_config.proto

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1662,7 +1662,7 @@ message ModelEnsembling
16621662

16631663
//@@ .. cpp:var:: uint32 max_inflight_requests
16641664
//@@
1665-
//@@ The maximum number of concurrent inflight requests to ensemble steps.
1665+
//@@ The maximum number of concurrent inflight requests at each ensemble step.
16661666
//@@ This limit prevents unbounded memory growth when decoupled models
16671667
//@@ produce responses faster than downstream models can consume them.
16681668
//@@ Default value is 0, which indicates that no limit is enforced.

0 commit comments

Comments
 (0)