Skip to content

Commit 1510e3b

Browse files
sxufacebook-github-bot
authored andcommitted
Static attention: support local-global attention (pytorch#13043)
Summary: Runtime: support different cache lengths for different layer. Python: add sliding window cache update which was already in the runtime. Reviewed By: billmguo Differential Revision: D79267644
1 parent cf2f170 commit 1510e3b

File tree

3 files changed

+264
-136
lines changed

3 files changed

+264
-136
lines changed

0 commit comments

Comments
 (0)