feat: Log probabilities support (with cache)#215

ruivieira wants to merge 4 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

ruivieira:logprobsruivieira/llm-d-inference-sim:logprobsCopy head branch name to clipboard