Update e2e/lm-eval test infrastructure#1323

kylesayrs merged 3 commits intomainvllm-project/llm-compressor:mainfrom

drop-unused-flagsvllm-project/llm-compressor:drop-unused-flagsCopy head branch name to clipboard