Skip to content

v0.2.1
Compare
Choose a tag to compare
@bhavnicksm bhavnicksm released this 11 Nov 21:15
· 11 commits to main since this release
v0.2.1
c8af1c6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • Add support for WordPiece Tokenizers + Aya Family by @bhavnicksm in #9

Full Changelog: v0.2.0...v0.2.1

Contributors

bhavnicksm
Assets 2
Loading