Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tokenizer] A brief intro and tutorial for sentencepiece. #17

Open
keli-wen opened this issue May 13, 2024 · 0 comments
Open

[Tokenizer] A brief intro and tutorial for sentencepiece. #17

keli-wen opened this issue May 13, 2024 · 0 comments
Assignees
Labels
[Tokenizer] Work Item Mixture-AI Work Item

Comments

@keli-wen
Copy link
Member

Description

At the beginning, I'm confused about sentencepiece. It would be better to provide a brief introduction and tutorial (with code examples, if possible) to reduce confusion about the role and function of sentencepiece.

References

@keli-wen keli-wen self-assigned this May 13, 2024
@keli-wen keli-wen added the Work Item Mixture-AI Work Item label May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
[Tokenizer] Work Item Mixture-AI Work Item
Projects
None yet
Development

No branches or pull requests

1 participant