Skip to content

Releases: gautierdag/bpeasy

v0.1.4

29 Aug 16:52
Compare
Choose a tag to compare

Fixes #2

Full Changelog: v0.1.3...v0.1.4

v0.1.3

23 Aug 10:39
Compare
Choose a tag to compare

Full Changelog: v0.1.2...v0.1.3

v0.1.2

19 Dec 10:46
Compare
Choose a tag to compare
  • fix byte 255 missing in initial vocab
  • use fxhash for slightly faster hashing

v0.1.1

15 Dec 14:48
Compare
Choose a tag to compare

Proper versioning

v0.0.2

15 Dec 14:33
4686982
Compare
Choose a tag to compare

Added tests and training function to Tokenize class for convenience.

v0.0.1

15 Dec 12:39
Compare
Choose a tag to compare

Initial release