Update logic of response generation in case of dataset usage#257

mayabar wants to merge 3 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

mayabar:datasetsmayabar/llm-d-inference-sim:datasetsCopy head branch name to clipboard