We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 34f0486 commit 58eaa55Copy full SHA for 58eaa55
src/ensemble_scheduler/ensemble_scheduler.h
@@ -84,7 +84,7 @@ struct EnsembleInfo {
84
// backward path, ensemble tensor to the step that provides its data
85
std::unordered_map<std::string, size_t> tensor_to_prev_step_;
86
87
- // Maximum concurrent inflight requests from steps to downstream consumers.
+ // Maximum concurrent inflight requests to ensemble steps (downstream consumers).
88
// Prevents memory growth by blocking producers when limit is reached.
89
// Default value is 0, which indicates unlimited (no backpressure applied).
90
// Configured via 'max_inflight_requests' field in ensemble_scheduling.
0 commit comments