Skip to content

Commit c3cae87

Browse files
committed
Fix regression (banned strings)
1 parent 4c23cb9 commit c3cae87

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

exllamav3/generator/job.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -842,7 +842,7 @@ def prepare_for_queue(self, generator, serial_number: int, rq: bool = False):
842842
self.max_rq_tokens = self.max_new_tokens + 1
843843

844844
# Compatibility checks
845-
assert not self.banned_strings or self.generator.recurrent_cache is not None, \
845+
assert not self.banned_strings or self.generator.recurrent_cache is None, \
846846
"Cannot use banned strings on recurrent model"
847847

848848
# Hash full pages of input IDs

0 commit comments

Comments
 (0)