v0.2.0
Added
- Added the
memoizeargument tochunk(), which memoizes token counters by default to significantly improve performance.
Changed
- Improved chunking performance.
memoize argument to chunk(), which memoizes token counters by default to significantly improve performance.