Skip to content

v1.1.3
Compare
Choose a tag to compare
@belladoreai belladoreai released this 07 Aug 21:50
· 18 commits to master since this release
v1.1.3
a0c62e0
  • Fix bug in a function that was unused (so not affecting tokenizer results)
  • Support very large inputs (previous version was not guaranteed to produce correct results for inputs larger than 100 000 characters, although in practice it would almost always produce correct results for large inputs)
Assets 2
Loading