Add vllm:request_max_num_generation_tokens metric #243
Description
vllm:request_max_num_generation_tokens - This is the minimum of max-model-len - prompt length and max_tokens if defined.
{{ message }}
vllm:request_max_num_generation_tokens - This is the minimum of max-model-len - prompt length and max_tokens if defined.