Skip to content

Releases: mashu/SequenceTokenizers.jl

v0.0.5

31 Aug 08:34

Choose a tag to compare

SequenceTokenizers v0.0.5

Diff since v0.0.4

Handle transforming back with zero tokens which should get decoded correct to unk symbol instead of zero indexing error.

Release v0.0.4

19 Aug 12:25

Choose a tag to compare

  • Fixed return type to be Float32 for the SequenceTokenizer
  • Updated compatibility
  • Manually triggered release

Full Changelog: v0.0.2...v0.0.4

v0.0.2

10 Aug 06:45

Choose a tag to compare

SequenceTokenizers v0.0.2

Diff since v0.0.1

v0.0.1

10 Aug 06:11

Choose a tag to compare

SequenceTokenizers v0.0.1

Merged pull requests:

  • CompatHelper: add new compat entry for OneHotArrays at version 0.2, (keep existing compat) (#3) (@github-actions[bot])