Skip to content

Commit c882fe6

Browse files
author
Sanggyu Lee
committed
let it work in more environment
1 parent ad53700 commit c882fe6

File tree

1 file changed

+1
-0
lines changed
  • test/modules/model/TinyLlamaWithFusedAttention

1 file changed

+1
-0
lines changed

test/modules/model/TinyLlamaWithFusedAttention/model.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,7 @@ def __init__(self):
3030
)
3131
self.rtol = 1e-4
3232
self.atol = 1e-4
33+
register_dynamic_cache()
3334

3435
def forward(self, *args, **kwargs):
3536
self._call_count += 1

0 commit comments

Comments
 (0)