We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5550827 commit 0e591faCopy full SHA for 0e591fa
README.md
@@ -39,7 +39,7 @@ def chunk(
39
40
This function returns a list of chunks up to `chunk_size`-tokens-long, with any whitespace used to split the text removed.
41
42
-## Methodology 🔬
+## How It Works 🔍
43
`semchunk` works by recursively splitting texts until all resulting chunks are equal to or less than a specified chunk size. In particular, it:
44
1. Splits text using the most semantically meaningful splitter possible;
45
1. Recursively splits the resulting chunks until a set of chunks equal to or less than the specified chunk size is produced;
0 commit comments