Fixed bug.

Author: umarbutler

CHANGELOG.md

@@ -1,6 +1,10 @@
 ## Changelog 🔄
 All notable changes to `semchunk` will be documented here. This project adheres to [Keep a Changelog](https://keepachangelog.com/en/1.1.0/) and [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [3.0.1] - 2024-01-10
+### Fixed
+- Fixed a bug where attempting to chunk an empty text would raise a `ValueError`.
+
 ## [3.0.0] - 2024-12-31
 ### Added
 - Added an `offsets` argument to `chunk()` and `Chunker.__call__()` that specifies whether to return the start and end offsets of each chunk ([#9](https://github.com/umarbutler/semchunk/issues/9)). The argument defaults to `False`.
@@ -105,6 +109,7 @@ All notable changes to `semchunk` will be documented here. This project adheres
 ### Added
 - Added the `chunk()` function, which splits text into semantically meaningful chunks of a specified size as determined by a provided token counter.
 
+[3.0.1]: https://github.com/umarbutler/semchunk/compare/v3.0.0...v3.0.1
 [3.0.0]: https://github.com/umarbutler/semchunk/compare/v2.2.2...v3.0.0
 [2.2.2]: https://github.com/umarbutler/semchunk/compare/v2.2.1...v2.2.2
 [2.2.1]: https://github.com/umarbutler/semchunk/compare/v2.2.0...v2.2.1

pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "semchunk"
-version = "3.0.0"
+version = "3.0.1"
 authors = [
   {name="Umar Butler", email="[email protected]"},
 ]

src/semchunk/semchunk.py

@@ -183,7 +183,7 @@ def chunk(
     # If this is the first call, remove any empty chunks as well as chunks comprised entirely of whitespace and then overlap the chunks if desired and finally return the chunks, optionally with their offsets.
     if is_first_call:
         # Remove empty chunks.
-        chunks, offsets = zip(*[(chunk, offset) for chunk, offset in zip(chunks, offsets) if chunk and not chunk.isspace()])
+        chunks, offsets = zip(*[(chunk, offset) for chunk, offset in zip(chunks, offsets) if chunk and not chunk.isspace()]) if chunks else ([], []) # NOTE `if chunks else ([], [])` ensures that we don't unpack an empty list if there's no chunks (i.e., if the provided text was empty).
         chunks, offsets = list(chunks), list(offsets)
 
         # Overlap chunks if desired.

tests/test_semchunk.py

@@ -185,6 +185,9 @@ def test_semchunk() -> None:
     # Try enabling a progress bar.
     chunker([DETERMINISTIC_TEST_INPUT, DETERMINISTIC_TEST_INPUT], progress = True)
     chunker([DETERMINISTIC_TEST_INPUT, DETERMINISTIC_TEST_INPUT], offsets = True, progress = True)
+    
+    # Test chunking nothing to ensure no errors are raised.
+    semchunk.chunk('', 512, lambda *args: 0)
 
 if __name__ == '__main__':
     test_semchunk()