pkg: add ability to provide number of choices sampled.#262

MadhavJivrajani wants to merge 2 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

MadhavJivrajani:n-request-paramMadhavJivrajani/llm-d-inference-sim:n-request-paramCopy head branch name to clipboard