Skip to content

Releases: semji/gpt3-tokenizer-php

v2.0.0: Merge pull request #5 from semji/build/2.0.0

07 Feb 09:18
cacdb30
Compare
Choose a tag to compare
  • Fix licence
  • Add Dev tools to improve DX
  • Refactor and improve code readability
  • Improve performance by using native function and local caching

v1.0.1: Merge pull request #2 from semji/fix/tokenizer_repeted_content

06 Feb 10:53
32ec7d0
Compare
Choose a tag to compare
  • Fix issue when duplicated terms are tokenized

v1.0.0: Merge pull request #1 from semji/improve/encoder

06 Feb 10:52
55922d5
Compare
Choose a tag to compare