TransformersPHP v0.5.3
Pre-release
Pre-release
This release brings new features, critical bug fixes, and improvements to enhance the functionality and performance of the package. Below is a summary of the changes.
What's New
- feat: Add support for PostProcessor Sequence by @CodeWithKyrian in 2cf18cc
- feat: New tensor method
randomby @CodeWithKyrian in 0564dd1 - feat: Correctly parse and use the Precompiled Normalizer by @CodeWithKyrian in 7e880dd
- feat: Update conversion notebook to include task by @CodeWithKyrian in ca6fc3b
Bug Fixes
- fix: Regex bug in Precompiled Normalizer by @CodeWithKyrian in 69089b1
- fix: Improve Unigram Tokenizer handling of multibyte strings by @CodeWithKyrian in e8a8a9a
- fix: Correct WhitespaceSplit Pretokenizer handling of invisible space characters by @CodeWithKyrian in 6ec3e3e
- fix: Correctly handle multibyte strings in Precompiled Normalizer by @CodeWithKyrian in bee47e0
- fix: Fuse function not combining unknown token IDs correctly by @CodeWithKyrian in 3008013
- fix: Tensor topK error when -1 is passed by @CodeWithKyrian in 0564dd1
Improvements
- fix: Precompiled Normalizer improvements by @CodeWithKyrian b012400
I encourage everyone to update to this latest version and explore the new features. As always, feel free to report any issues or contribute to the project.
Full Changelog: 0.5.2...0.5.3