Bugfix: was accessing number of tokens from nil var; getting it from req instead#177

github-actions[bot] merged 2 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

pancak3:dev/bug-fixpancak3/llm-d-inference-sim:dev/bug-fixCopy head branch name to clipboard