Skip to content

Commit a8a7ab2

Browse files
committed
Removed a unit test.
1 parent 7fd64eb commit a8a7ab2

File tree

1 file changed

+1
-12
lines changed

1 file changed

+1
-12
lines changed

tests/test_semchunk.py

Lines changed: 1 addition & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -79,15 +79,4 @@ def tiktoken_token_counter(text: str) -> int:
7979
except ValueError:
8080
worked = True
8181

82-
assert worked
83-
84-
85-
def test_merge_splits_zero_tokens() -> None:
86-
"""Test case where midpoint is 1 and the first split is whitespace.
87-
This can result in the token_counter returning 0 tokens. Ensure we don't divide by zero.
88-
"""
89-
try:
90-
result = semchunk.semchunk.merge_splits([' ', 'text here', 'more text'], 20, ' ', lambda s: 0)
91-
except ZeroDivisionError as exc:
92-
assert False, "merge_splits raised exception {exc}"
93-
assert result == (3, ' text here more text')
82+
assert worked

0 commit comments

Comments
 (0)