Skip to content

FEAT: Add In-Flight Concurrency Limiter Middleware (Bulkhead) #5

@MrEthical07

Description

@MrEthical07

Background:
Rate limiting controls request rate, but not concurrent in-flight pressure on expensive handlers.

Problem:
Under bursty traffic, high concurrency can still saturate downstream dependencies despite rate limits.

Scope:

Tasks:

  • Implement configurable concurrency cap middleware.
  • Define overflow behavior and response status.
  • Add metrics hooks for accepted/rejected counts.
  • Add tests for cap enforcement and recovery.

Acceptance Criteria:

  • Requests above configured cap are rejected predictably.
  • Middleware is disabled by default unless configured.
  • Load tests show improved stability under burst concurrency.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions