Skip to content

Remove excess no-op kv cache reshardings in llm benchmark now that output shardings are preserved#827

Open
jameszianxuTT wants to merge 1 commit intomainfrom
jzx/no_reshard_generate
Open

Remove excess no-op kv cache reshardings in llm benchmark now that output shardings are preserved#827
jameszianxuTT wants to merge 1 commit intomainfrom
jzx/no_reshard_generate

Commits