Take cached prompt tokens into account in prefill time calculation#184

github-actions[bot] merged 2 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

irar2:cachedirar2/irar2-llm-d-inference-sim:cachedCopy head branch name to clipboard