Remove excess no-op kv cache reshardings in llm benchmark now that output shardings are preserved#827
Open
jameszianxuTT wants to merge 1 commit intomainfrom
Open
Remove excess no-op kv cache reshardings in llm benchmark now that output shardings are preserved#827jameszianxuTT wants to merge 1 commit intomainfrom
jameszianxuTT wants to merge 1 commit intomainfrom