test: Scale up and down the model server during an end to end test#354

shmuelk wants to merge 6 commits intollm-d:mainllm-d/llm-d-inference-scheduler:mainfrom

shmuelk:scale-up-down-testshmuelk/llm-d-inference-scheduler:scale-up-down-testCopy head branch name to clipboard