Releases: semji/gpt3-tokenizer-php
Releases · semji/gpt3-tokenizer-php
v2.0.0: Merge pull request #5 from semji/build/2.0.0
v1.0.1: Merge pull request #2 from semji/fix/tokenizer_repeted_content
- Fix issue when duplicated terms are tokenized
v1.0.0: Merge pull request #1 from semji/improve/encoder
- Fork from https://github.com/CodeRevolutionPlugins/GPT-3-Encoder-PHP
- Use Object structuration