Skip to content

Commit

Permalink
README.
Browse files Browse the repository at this point in the history
  • Loading branch information
belladoreai committed Mar 24, 2024
1 parent 0acdab6 commit 80d90d8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@ If you want to modify this library to support a new LLaMA tokenizer (new as in t
You can pass custom vocab and merge data to the tokenizer by instantiating it like this:

```
import { llamaTokenizer } from 'llama-tokenizer-js'
import { LlamaTokenizer } from 'llama-tokenizer-js'
const tokenizer = new LlamaTokenizer(custom_vocab, custom_merge_data);
```

Expand Down

0 comments on commit 80d90d8

Please sign in to comment.