[Inference API] add service and task type aware rate limiting#125880

brendan-jugan-elastic wants to merge 10 commits intoelastic:mainelastic/elasticsearch:mainfrom

brendan-jugan-elastic:dev/rate-limiting-follow-upsbrendan-jugan-elastic/elasticsearch:dev/rate-limiting-follow-upsCopy head branch name to clipboard