Skip to content

Add rate limiter & metrics to the POSIXv2 implementation#3054

Merged
bbockelm merged 11 commits intoPelicanPlatform:mainfrom
bbockelm:rate_limiter
Feb 9, 2026
Merged

Add rate limiter & metrics to the POSIXv2 implementation#3054
bbockelm merged 11 commits intoPelicanPlatform:mainfrom
bbockelm:rate_limiter

Conversation

@bbockelm
Copy link
Collaborator

No description provided.

@bbockelm bbockelm linked an issue Jan 31, 2026 that may be closed by this pull request
@bbockelm bbockelm added enhancement New feature or request origin Issue relating to the origin component labels Jan 31, 2026
@bbockelm
Copy link
Collaborator Author

bbockelm commented Feb 3, 2026

@patrickbrophy - can you take a look at the Prometheus changes here? It's the first stab at making POSIXv2 & XRootD monitoring compatible (the f-stream portion is not done but will need to go in a separate PR just to break things up a bit). I'm happy with the HTB / fair-share stuff.

Copy link
Contributor

@patrickbrophy patrickbrophy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some small nits. I was ultimately concerned with the compatibility with existing metrics.

Key observation - the waiters need to generate their own ticks to
refill the bucket since there is no background goroutine doing that.
- Remove unused HTTP & POSIXv2 metrics
- Improve tests to actually demonstrate fair-share is working
- Add Force method to HTB since tokens must be acquired while reads
  are ongoing
Additionally, fix the bytes read metric to not depend on the HTTP
headers but the actual bytes read.
@bbockelm bbockelm force-pushed the rate_limiter branch 2 times, most recently from a29fae1 to bcd8e93 Compare February 9, 2026 04:04
Copy link
Contributor

@patrickbrophy patrickbrophy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Things look good on the metrics front.

@bbockelm bbockelm merged commit 75558e6 into PelicanPlatform:main Feb 9, 2026
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request origin Issue relating to the origin component

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add rate limiting and monitoring for POSIXv2

2 participants